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PREFACE 



The single purpose oi this publication is to provide a basis foi; judgement on the part 
of the reader* about a recent development designed to support the policy making 
management function for occupational ^ucation at the state level. This development is 
called the Management Information System fpr Occupational Education (MISOE). 
Although MISOE has been developed for occupational education, it could serve as a 
prototype for all pubjic education a:nd has implications for the .development of social 
policy beyond education. It is hoped that this publication will provide a necessary basis 
for a judgement about the usefulness of MISOE ^y a wide range of readets, from 
legislators to concerned hiy citizens. ' ^ 

It is recommended that the reader immediately skip to Chapter 1, which describes the 
nature of the development offered for evaluation. For the reader who is persuaded that 
MISOE is sufficently valuable to- warrant an examination for the purpose of evaluation, 
Chapter 1 also provides a ^ide to the publication which is desigaed to help arrive at a 
knowledge-based judgement with a minimum investment of precious time. If the 
reader's eva^luation is positive, we would like to insist upon his returning to read the 
following paragraphs of acknowledgement. 

The development of MISOE has occupied approximately three years of the Principal 
Investigator's life and could not have been accomplished without the specific 
contribution of the following people: • 

Charles Buzzell, Associate Commissioner, Division of Occupational Education, 
Massachusetts Department of. Education, -has provided support, inspiration and (above 
all) **beat ttie Philistines back", thus allowing MISOE to become. The management , 
leadership demonstrated by Charles Buzzell shoui||d serve as a role model for 
, 'development, research and progress in government. It is not easy to provide support for 
* a development >vhose implications are hardly understood by- a substantial number of 
one's colleagues and, at the same time, a development that challenges the current 
practices of other colleagues. 

Elizabeth Weinberger, Research Associate, MISOE staff, whose logic, persistence and 
insight' are responsible for a substantial part of MISOE. Miss Weinberger wrote Chapter 
7, and contributed mightily to the substance of Chapl^i&4, 

John Creager, Division Director, Division of Educational Statistics, American Council 
on Education has provided MISOE with valuable assistance during this development. Dr, 
Creager is a first rate social scientist who is more responsible for the development of 
MISOE Sample Dita Systems than anyone. His genius is reflected throughout this entire 
publication. . * 

Martin Breslow,. Research Associate, -MISOE staff conceptualized the interactive 
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computing system Vor MISOE ant! played a major role in developing tlie MISOE Cen&us 
Data System. THe range -of accomplishments described by these two functit)hs speaks to 
the insightfulness of Mr. Breslow. Chapters 3 and 6 represent his Contributions to 
MISOE hi tliis publication. ^ 

William Kyfbs, Research Associate, MLSOE staff developed TERMOBS for MISOE. 
We consid^*r TERMOBS an important development -for occupational education, and 'Bill 
Kyros is pYobably the only person in tlie world who luis been able to make sense out of 
performance objectives for instructional management at the state level. 

Gerald Downey, Assistant Professor, Lowell Technological Institute", singfe handedly 
developed the cost analysis system for jJJ^ISOE. As a part of this function, Dr.^ Downey 
helped develop the 'CDS Reporting System, and wrote Chapter 5 of this publication. 

Micliael .Caret, (p-art-time MISOE statF member. and graduate student Systems 
Dynamic Department, Sloan School of Management, Massachusetts Institute o-f 
Technology, minoring in education and social policy at Harvard UniverSfty) is 
responsible tor adopting j:lynamic simulation to MISOE. He alone has developed the 
model of Chapter 9, and, in addition earlier models for MISOE. Dynamic simulation is 
very much a part of the total conception of MISOE and Michael Caret is -responsible for 
the development of the Ht of this vital process into MISOE. 

Finally, without our secretarial staf■^ we wx)uld simply not be able to communicate 
our development to anycJne. They are Mrs. Anne Bowes and Mrs. Majorie Alongi. On 
behalf of the entire MISOE staff, I publicly acknowledge our debt to these women. 



William C. Conroy, Jr.. 
Xhicst Udiior 
Principal Investigator 
Management Information System for 
Occupational Education 
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CHAPTER 1 
A STATEME-NT OF INTRODUCTION 



J - ■ 

William G. Conroy, Jr. 



This chapter is intended to accomplish 
three separate goals: 

1. to offer a statement of purpose for 
; J MISOE; 
. 2. to suggest implications of MISOE for 
managers of public education and society 
at large; and 
3. to present a guide for efficient reading of 
this .publication. . 

.1 Statement ofMJSOIi Piirpos'c 

The purpose* of MISOE is to provide a 
computerized, information suppQrt capa- 
bility for those charged'' with the 
responsibility of planning tor occupa- 
tional education at the state level. MISOE 
has been purposefully designed to support 
the planning prdcess by allowing man easy 
access to information and operations to 
analyze information such that experience 
can influence the process of, policy 
formulation. MISOE has been developed 
upon the fundamental /assumption that a 
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capability 'for man to analytically interact 
with experience will contribute to a better 
understanding of the future consequences ^ 
of current policy. To accomplish this 
goal, MISOE has- adopted *\state of the 
art" .computer technology to equip the 
manager with a capability to enter ♦into an 
interactive dialogue with information and 
simultaneously provide analytical tools to 
examine this experience in light of future 
goals. 

MISOE Xonceives of resouce allocation 
as the fundamental state level^^pfajuiing 
function for occupational edwcation; i.e., 
assigning funds to specific alternatives 
wl/ich are designed to cause desired 
otttconifs to occur. Planning in occupa;- 
tional education includes . describing 
program characteristics, stipulating the 
range and number of students to be served 
and stating the desired outcomes for" 
individuals who e^xperience these planned 
programs and, society a wh<:^le. These 
plans include a statement of social and 

8 . — 



private costs, aiicpwr'Trxp licit estimation ot 
the ecoucnpie'ixMietits tor .society and the 
so-caiit>duirget students. 

he planning or policy-making, 
ijianagement function supported by 
MISOE includes the following three levels, 

1. The Overall Social Agettcie,^ Level 
Planning at this level is typically done by 
the legislature, and determines the optimal 
mix o(. educStion with other social icrviees 
necessary to achieve dcjiiftrlrte societal 
goals, * ^--""^""^ 

2. The Overall-Education Level Planning at 
thi>-4t5vel is usually done hy the Chief State 
School officer and his staff, and seeks to 
stipulate the optimal mix of occupational 
and"^ nonoccupational education ncce.=;sary 
to attain specified societal goals. 

3. The Within Occupational Education Level 
- Planning at this level is most frequently 
done by a division or bureau at tire state 

^ department of education and decides the 
specific occupations for which students are 
to be prcpiired, the occupational capabili- 
ties Within occupational programs with 
which students are to be prepared, and the 
I program characteristics which seem most 
likely to help students achieve learning 
objectives of occupational education 
programs. 

MISOE as.sumes 'that the degree to 
which the state manajj^ient level permits 
local 8;overnment to/initiate plans at any 
of these levels is discretionary to the 
legislature. Although MISOE is helpful for 
planning at the local level, its primary 
purpose is to support statewide policy 
formulation for occupational education. 
Simply bec'/use MISOE is designed to 
support stafewirte planning, it does not 
' follow that it . disregards . the loc^l 
educational planning function, even 
though it clearly distinguishes between 
] these governmental levels. A reasonable 
V description of the distribution of plannk 
Responsibility for education between s^ate 



and local governments assumed by* MISOE 
in development is tiiat local planniiig 
occurs with a statewide framework; 
MISOE has been developed tp help 
policy-making managers at the §tate level 
specify that framework or structure tor 
occlhpational education, witjiin the demo-_ 
cratic tradition.' - - ^, " 

MISOE conceives of ^occupational 
edu/ation as an alternative means tor 
achieving desirable and specified societal 
goals. Further, the only reason society 
supports the practice of occupational 
education is because of its perceived, 
positive contribution to the attainmAit of 
these goals, MISOE has been developed to 
provide policy-making managers at uU 
levels (hereafter, managers) vs^ith an 
information system designed to help them 
understand relationships between occupa- 
tioniti education and the society it serves 
in a way that supports planning for the 
future afthe state level. „ 

MISOE supports the principle that 
policies for education mu.st be made on 
the' basis of future benefits, and that the 
future time frame which constitutes this 
basis ^ for public education is several 
generations. Whether the political struc- 
ture which controls public education in 
America can tolerate futurism , as a 
foundation for planning is not at all 
certain, nor is it certain that middle 
managers of public education are 
particularly concerned with taking 
society's future into account as they 
**imiovate change." 

MIS(.)H Implicatiom for Mana^cn and 
Society 

It is obviously difficult to 'speculate 
abput the influence of a development yet 
to be implemented. It seem§ more sensible 
to suggest a perspective- or **something-to 
think about" while forming an evaluation 



ERIC 



9 



ot MISOE, iuul that is "Wltat arc the 
hkely consequences xMISC^E on bi)th 
the policy-maker and the policymaking 
function?*'' 

• Thtf gual ot- MfSCTB is to provide 
nianaj^pnient with a better understanding 
ot* tlie hiture consequences ot current 
pohcy through numerical and interactive 
analysis ot experience, this publication 
will describe, MISOR allows management 
to browse and analy/e a widw ranging data 
description ot past succej^j^^and failures 
in a wav that is at the^ame time 
responsive to an enormous variety ot " 
policy hvpothcses and predictive ot tuture 
consequences. As an interactive, comput- 
ing capability, MISOE provides manage- 
ment with immediate response to 
convplex questions. This respo|ise is likely 
to yause new understandmgs and in,yghts, 
generating more questu)ns. ^t-^H^tttnued 
interaction between management and 
Ml5>OE could be described as a developing 
chain ot. knowledge which suggests v'^itisal , 
relatioij^hips among parts ot man's world. 
Some of these interactively developed 
understandings will question previously 
fceld beliefs, while many ''tacts'' will be 
confirmed. Usually, the dev^^lopinent ot a 
policv-relevant understanding will result 
from a fairly substantial dialogue with the 
MISOE interactive computing systtyn. 

It should be pointed out that MISOE* 
has been designed such that tew technical 
skills are required to browse and analyze 
the data files, hov^ever, some numerical 
analysis skills are required to interpret 
numerically described experience. Giv^n 
this brief dcscriptio-n ot the process bt 
^'thinking with ina'chine'\ it seems 
reasonable to hope that those attempting 
to* determine the usefulness of MISOE will 
develop a position on its likely 
consequences for the' policy-making 
manager, whether tie be a Legislator, *a 

.teacher, a Chief State School Otticer, a 



member of a State Board of Education, a 
student, a citizen or an Associate 
Oommissioner lor Occupational Educa- 
tion. 

One way o/ thinking about ranges ot 
responses to this question is to attempt to 
tix a position on a 'continum which coulcl 
be described by the following* extreme 
points: 

1 , Management shoulil rely on a research staff 
to briiwsc and analyze experience for 
policy development, probably developing , 
recommendations . within a range of 
alternative constraints: or 

2. PoUcy making management should define 
its tunction to include the development of 
new understandings through direct, inter- • 
active and analytical dialogue with 
experience. 

It is obviously not possible to develop a 
detinitive position until there has been 
considerable experience on the part ot 
policy-making managers with interactive, 
computer svstems. Unfortunately, the 
past performance of ctunputers in 
providing numerical analysis c/ experience 
as a support for policy formulation has 
been dismal. Usually computers have been 
used to answer one or two question, 
typically formulated by policy-makers, ' 
but answered by.researclier^from one'or 
several disciphnes. Researchers access 
computers through a data processing 
team. ^The computer is used to process V 
and analyze a mountain ot information 
against these one or two , questions. The 
result ot this experieiice is typically a final 
report, which can either be accepted or 
rejected. If the final report provides new 
understandings requiring mor^ informa- - 
tion, another study nmst be undertaken. 
On the other hand, MISOE offers a 
capability for managers to enter into a 
direct interaction with experience (struc- 
tured by the logic of multi-disciplines) in 
the process of arriving at new under- 



sraiiJings tor the purpn^v pmUcv 
torinulatioii. ( ^ik* ,ij*julJ .ii'k^n^' di.it 
pt)licr iiiaknig inaiuigcrs who delegate- t< > 
subordinates the . task - »1 piiilnng and 
analv/ing experierice are in taei "givine 
a\Vdv'* tlu* t'lHidanu-ntal pi)lic\ making 
• taNk, even though ilitterent skills than 
t\pieall\ pi^sesseil by the average 
poliev-niaker are reqmred tor ut'ili/atiwn 
otMISOF'. ► V 

It is re^ts^uable to speenhjte about the 
iiuplieations tjt iVtiSOH on society as part 
oi tiie pn.K'ess ot.e\"aluating its 'Usetuliiess. 
Again, it niiglit be helptul to traiiie a- 
resp(?iise ahmg a continuum ^detiiied by 
the following rwo poles: " • 

\ . In tht* ^Miids otL-ii Fascist and closed 
a(lnunij>tr;ttion it could tacilit.ite a 
ccnrralization ut piilky niakint; tor puhlic 
education; or 
- 1/ In the hands- ot a democratic and open 
administration it can provide a basis for 
contributing to the improvement of the 
^ qtiaiity ot life. 

Aitliough it 'is not an unreasonable 
conclusi(Mi that freedom is f'requcMitly the • 
function of governmental ignorance, it 
seems nut unreasonable to hope that 
knowledge can c^uitribute to improving 
the lot of* man during his brief* tenure on 
earth, without necessarily causing political 
Y revoiutioii- 

.1 (Aiide to rudcrstanding AJISOl: 
rhroni^li tills I^nblicatio}i 

This publication is designed to serve a 
wide range of educational policy-makers 
hiclueling: legislatures; state department 
ot" education personnel; superintendents: 
principals and teachers; school boards: 
and concerned citizens. It is difficult to 
accomplish this goal with one publi- 
cation. However, the following tew 
paragraphs are designed to grovide the 
reader with a guide so that 



can get 



tt> the *MKMrt iii the matter'' with a 
reasoncd)le time investment. Then, it he is 
suf'ficientK'Muterested m Uaruing derails 
ot tlie MISOE' structure, he can "dig nunc 
deeply" intn selected sections of tlus 
publi< ation. All this is not to discour-iige 
the reader from carefully wading through 
the entire vnluiiie, as such an exercise will 
pro\ide inaxiniuin uiiderstaiidiiig.. 

One word of caution. T\ic single 
purpose of this pubjicatioii i-s to provide a 
biisis tot judgement of a devehipiiieiit tor 
eihicational management. It is possible to 
evaluate this development wntli absolutely 
no intorniation at all, simply cm. the basis 
of "an iiiiiiiediate response to a vaguely 
understood stimulus. Such an activity is 
of no' value ^ to providing a basis tor 
advising (Uliers. On the tether hand, a 
reader can become hopelessly buried in 
the details ()f this publication, and base 
his judgement on soim^iing other than 
the -essence of the potential of MISOE to^ 
serve society. The follgvfing guide should 
lu^p the reader strike a balance .between 
these extremc^sK^,^^^ - . . > 

'( .haptcr 2 is a oesttiption of a certain 
basic components of MISOE that are 
iietessary to understand its scope. It is 
described as a necessary dictionary 
experience (evil) and should be ''carefully 
skimmed'' by all readers. 

(Juiptcrs 3, 4, 5/ ajul describe in some 
detail (nontechnical ) important com- 
ponents of MISOE wliicli are overviewed 

\apter 2\ These^ cliapters^will be ot 

siderable interest to reade/s who are 
moving toward a positive evaluation ot 
MISOE and who want to learn of its 
structure. However, the uncommitted, 
probing aad^-asual reader wants to arrive 
at such a positive . evaluation (or j^iot) 
before iiivesting^his valuable time with aii 
indepth analysis; he should '^quickly 
skiiif' these chapters. The **uiicommiUfed 
skimmer" should atteinptVto seek a iJoad 



u 



uiiA*rstaiuliiig <»t tiic int» »rnuitit types 
MIS(^E as Uc nucs tlirongh t'luiptcis 4. 
, and 5, as vvell as a "K-cP' Kn^thc otuiiptiti'i 
ttTimn.il aiul Hlc scrticturv clcsM'.ibotl in 
C:haptcr (k / 

(.h.iptt^f 7, siioukl Ik* rorul tihout as ^ 
carehillv as (!h.if[ncr 1. Irs piirpi«sL* is tii' 
provide a reader w'itHs^iu understanding ot 
the process tjt \;iAterin|Xi!ito an interactive 
dialogue with * .i computer/ It is 
purpose hdiv ,v* >iHer sati* >nal and^h< j{v tuHy 
enligiiteuing. It is a ne.eessarv/prerequt*iite 
to chapter H, 

i if.ititt f S Is designe^d Co oHer tbe 
• rt'ader an 'experient*e. in pohcy tornnda 
tiun vvitb MISdK. It sT>eaks for itselt* and 
is the basis upon whieli a judgetuent about 
Mh^OE shiHihl.lH' made. Untortunately. 
^the reailer is constrained by the logic oF 
the example, in real^ iMISC )E he could 
probe along any branching chain his logic 
dict.ited, withni the boundaries t)t the 
MISOE data structure. All the data 
presented in Chapter 8 are inaiuitactured 
tor the purpose ot this example, as are all 
the data anywhere in -this public.uion. 

('liapttr V describes and r)il:ers an 
example /F uiiderstanding and • inter 
pr^'ting experience through a motlelling 
proc^'ss. The process described is called 
dxiuunii " <imuLitio}i. and is Aso sup- 
ported by an interactive computer 
capability. 

When man as a llet^rminer of social 
p(j|icy interac ts with* MISOE as described 
in chapter H, he could be described -as 
(Sperating irom a model or conception ot 
t\vc world at large, Hi.s dialogue with 
jexperience extends his understandings 
about this world. His conceptual model trt 
the world is constrained by the number ot 
elements he can "juggle'' in his mind^^-^ 
one time. Frequently -^e developjwefit of 
social policy involves "juggling'' more 
elements at one tinre ' than man can 
acc<)nnn<)date*l:>ynamic sinudation offers 
a coniputer assisted niethodoh)gy to deal 



vvuli and/tU'Velop iffulerstandings about 
coniph/^ soci.il issiu\s< Unlike other 
tcilmiques m.ulieni.uical progianunin^ ! 
i>r tuudanicnita! purpose^ is not ti> specitv 
. )ptinnun . , and simphticd sokui^ 'n.^ t' » 
complex probuMUs, but ratliei to 
lUitrjbute to a deveh^pnuMit ot under 
standings on the part ol human man.igers 
about tlu' ♦ lundamental nature of 
relationships between ehnflents relevant to 
a particular si^cial policy m tornudation, 
hvnamic" simulation can be particularly^ 
useful in making explicit those elements 
tf be , acted upon b^' a policy in huure 
rime^ and communicating understandings 
aht.au alternative outcomes from various 
policy th'cisious. It is n\ost useful at the 
Over, Social Agency Level, Dynamic 
"simuhuion has been in('(upj)rated itito 
MISOE as a supportive priicess for poficy 
making, when /c(nnbined with tlici 
interactive iniornuiC-ioii svbteni which 
constitutes the basis (if MISOE. Chapter 9 
sh(udd4;e re.id bv those who are at l(?ast 
nu)ving toward a positive, evaluation of.. 
MISOE as a resuj,t of completing (Chapter 
H. 

( Jijpti't '10 (jffers an assessment ot 
MIS(')E by a state lev^el manager for 
occupational education, an economist, 
and an educational researchejr, and they 
are: Hr. Charles Bu/7ell, Associate 
Connnissioner lor the Division ot 
, Occupational Education, Massachusetts; 
Dr. J.icob K.uifm.ui, Professor. Depart- 
ment of Economics, Pennsylvania State 
IJniversitv and D.ivid V. T i eel cimrirr Pro- 
fessor, Northern IllinoiiH:^hversity, This 
assessment luiji^^^JtKSf been written a,s an 
indepth ^yj^^dysis of MISOE, Its purpose is 
to^^-pfTnnde a suggested framework tor 
evaluating MISOE from 'three separate 
points of view. It is designed to help the 
reader reflect upon the usefulness ot 
MISOE, It shoul'd provide an interesting 
reference poiwt against which a reader can 
judge his evaluation. 
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CHAPTER 2, 

A FEW GENERAL DEFINITIONS AND DISTINCTIONS 



William Conroy, Jr. and William Kyros 



^^here seems tcx be a tendency amot>g 
hunmn beings working together over a 
long period of time to develop a language 
tor, communicating among riiemselves. 
One would expect the scope of the 
language to be positively related to the 
size and resoufcesfulness of the group 
members, and the length of time tliey 
worked together. Another predictor of 
langiiage si/e might be the Tutetion of the 
group. The development of computeri^edL. 
information systems must rank as one of 
the most powerful function predictors of 
jargon pKoductivity, and MISOE's overall 
performjance on this criterion is 
tormidaMe. 

Typiaally, members of such in-groups 
have iniVequent contitct with thfe world at 
large, anovthey become una\Vare that their 
private set of symbols do, not com- . 
municat^e beyond tjie group. Incredibly, it 
is not unusual for such group members to 
develop negative evaluations toward 
non-group mifmbers who cannot under- 



stand -their esoteqic Ij^nguage, - and* 
non-group members are often dismissed as 

'an inferior batch* of human beings, 
somehow i^inable to ui;id^fstand ' and 
appreciate beauty and truth. This seems 
particularly* true of professional groups/ 
and certainly workers in the field of 
educational development and research are^ 
not second.xlas^ professionals in terms of 
this particular standard. ♦ 

It would* probably possible for us to 
dTescfiU^NlISOE) in a way that i^ totally 
incompreK^^^ajble to anyone but the' 
' MISOE stafh^s^.^ matter of bitter 
historical fact, the MlSOE^ staff is guilty- 
of having done' tliis on a number of 
unforgettable occasions, and have paid, a 
high price for edch blunder. Oqe of tlie^ 
causal factors, of these communication 
failures by developers seems to^be tlie 

" intriguing complexity of the development 
process. The resolution of tlie enormous 
problems at hand always seems crucial, 
gnd there simply never appears to be time 
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to pull together a description of^progress. 
In hict, to the so-called development 
purist such activities are viewed as 
counterproductive, public relations 
forays. This is a particularly fascinating 
dilemma tor MISOE, since its Fundamental 
purpose is to develop an easy access, 
interactive computer system which 
involves complex technology and systems 
tor use by the educational manager, a 
group typically not distinguished by its 
track' record in applications of develop- 
ments by social scientists, or systems 
analysts. 

To afcomplish the single goal of this* 
publication, i.e., to communicate an 
understanding ot MISOE as 'A maniXgement 
support process such that a judgment of 
its usetuliiess can be made by the reader, 
it is necessary to stipulate a small part of 
the MISOE vocabulary, but this exposi-^ 
tion will be limited to the essential 
minimun\ required to understand MISOE 
structure. A maximum effort is being 
made to keep ''MISOE-eze" to a 
minimum, i.e., we are attempting to 
communicate in tiie common vernacular. 
fcThe. purpose of this short chapter is to set 
'forth a tew definitions and distinctions 
wlfich are absolutely necessary to an 
undecstandingv^and evaluation "of MISOE. 



A Co nee p) til aj/s triictu re 

A conceptual structure is nothing more 
than a plan for describing and classifying 
the parts of a whole and .the relationships 
among those parts. Typically, such 
structures aro^ a compromise between the 
complexity of the whole and the need for 
a. definable structure. Occupational 
education is a complex whole, managed 
by a wide range of individuals, fjrom the 
United States Congress to the loc^al school 
board, vv?th state boards of education, 
state administrators, teachers' unions, 
advisory groups and others wedged in 
betw^een. These factors suggest the need 
for a conceptual structure for occupa- 
tional ediication which is both compre- 
hensive and uncomplicated if it is to be 
useful as a basis for an information system 
designed to silpport management. 

The four boxes in Figure 1 are offered 
as a visual description of the conceptual 
structure of occupational education upon 
which MISOE is based. 

The conceptual, structure presented in 
FJigure 1 describes occupational education 
as a four element whole, in which 
students (input) experience a planned 
\orocess- The product of oc^partional 
edvLication includes the number of 



FIGURE 1 

A CONCEPTUAL STRUCTURE FOR OCCUPATIONAL EDUCATION 
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coiiiplctorv aiid the capjbilitieb. ot these 
cuinpletois which were fostered by the 
iiuei veiUiuri^ tot the eJiicatioiial process. 
I'he impact element a)t, the conceptual 
• structure is Jetined by: 

1. The impact oi the- product ot the 
educational prDgruni on .society over ti^ue; 
and , " \ 

2. The relationship between Tlie educational 
proce.ss experienced .by the student and his J 
subirtJijuent^ lite-style. 

Tliese stark descriptors are not' intended 
to dehumanize their i^bjects^ but rather ft,) 
prijvide clear distinctions among; parts ot a 
totality. Regrettably, such hib^di?ig seenii^ 
tii acco.mplish both objectives simul- 
tanetaisly. 

A r b i t r a r iTv , M 1 S ( ) E 's concept/ial 
description occupational education 

detines expenditures* as a part ol the 
process element withiii the model, and 
assigns so called contextual elements to 
input;. space. The contextual components 
include the non-school world ot the 
student. MISOE assumes that students 
are, hi part, defined by these tactors, and 
that they 'exert an interactive influence 
during the student's tenure within an 
educational program. MISOE contents 
- itsctf'witli measuring the ettect of tliese 
intluences upon the student by its 
comprehensive battery of measures that 
describe the student at point ot* entry into 
the program. 

Descriptive lufonnatioti 

The information types. of MISOE have 
been classified by the input, process, 
product and impact conceptual structure 
(IPPI) and are briefly described at this 
point. 

Ifiput Infonnatiofi describes the charac- 
teristics of the student at entry point into 
the program. This information is 
developed from tht^i so-called input 



battery ami includes a description ot 
students' JiBilities, aehievement, per- 
sonality, valued and his oiit- ot school 
envirtMinient Mioine,v ttiiiiily, peer rela- 
tions, etc.). / 

lhoccs^^--'yitor}!idtio}i describes ctMn-. 
ponents ' /n' the planned educational 
process^/f Iws information is wide ranging, 
and j,m:ludes such program d^ei^rriptiors as 
lei>^tli, cliaracteristiics of tJie statt, the 
;rt<iture of the school organization, etc. 
Process^ variables can be thought of as a 
basis for hypotheses formulation to 
explain differences in product or impact'.' 
All process variables result from a 
management plan or policy, a;id process 
information describes the results of these 
plans as prognim elements. Expeiuliture 
information describes process elements in 
terms ot dollars. 

' P^^odiict I}i fon:iiatio}i is constituted by 
three separate parts: ' • 

' 1. Simply whether the student is a completer 
- or a non completor; 

2. A description of general educational 
development, and 

3. A detailed statement of the occupational 
capabilities achieved by each completor 
within specific programs. 

Occupiitional capabilities are described by 
objectives which are called TERMOBS by 
MISOE, that ig terminal objectives. 
MISOE product information includes a 
comprehensive* measure of general educa- 
tional development to provide a basis to 
estimate those capabilities of completers 
which are not directly related to specific 
occupations, like reading ability or 
knowledge of social studies. These 
measures provide a basis for comparing 
students who have sacrificed non- 
occupational learning experiences to those 
who have not" specialized in a specific 
program designed to develop competence 
within named occupations. TERMOBS 
represent a major development effort of 
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the MISOE staff and will be dcbcnbed in' 
sDine detail later Lti tliis'cliapter, 

InipKict hifonfuition atteinprs ttj 
deiicribe -the 'experience ot program 
conipletors during post-program lite. The 
hnpact intt)rmation includes a description 
ot both occupational and nonoccupa- 
tional behavior, including measures of 
productivity, career patterns, voting 
^"ehavior and coninuuiity service. 

AndiytiCid Iniornitition 

Analytual inhirnuition describes rela- 
tionships anrong che.'lPFl elements. Their 
KuKlamental purpose is tt) ^provide a basis 
for assuming causa tioir ot one IPPI 
elemetit upon another, namelv process on 
product aud prtjduct on impact. In both 
cases such intofmation includes controls 
tor the human variability ot students as 
they interact with prqcess and the 
consequences ot" these diftert*nces in te'rnis 
of product and impact, llie description of 
the majoi' analytical intormation types ot 
MISOE assuines control.s. tor individual 
dittereuij^^s, \ 

Process Vrodikrt InfornUtioji describes 
relationships bet^veen si^ts ot educational 
process elements and ^ the resvilting 
product, as descril')ed by the pi'oduct 
'measures, i.e., number ot conipletors, 
general educational development oi' 
'TERMOBS." ihoccss product itiforfHation 
.seeks to describe systematicMelationships 
between a level ot productivity and the 
initiation and maintenance bt a c'ertain 
process mix, i.e., tlie interacting elements- 
jvithin an educaticj^Lil "program. For 
example, is- a hiculty with an average age 
of 46, an average verbal IQ.of 104, an 
^average '^i 5 years expe<rience in the 
specific occupation being oftered be.tore 
entering teaching and an average of 12 
years teaching experience i;nore likely tQ 
be associated with programs tliat producfe 



more competent tradesmen and tech- 
nicians than a taculty tluit is younger, on 
the average, but with less industrial 
experience betore entering teaching? 

MISOE's process battery represents a 
wide range ot process elements, trom 
tairly static characteristics like taculty age 
and progratn length to constructs like 
staff planruhiess, moonlighting and 
inbreeding. In general, tlic process battery 
includes n)ajor characteristics ot educa- 
tional programs necessary ^or planning, 
lijve 'staff characteristics aud program 
length, as well as a variety oi constructs 
"which , are both within the reach of 
uianageniont contiiol and have a high 
probability ol aca)unting for product and 
impact ditferences. ♦ 

Cost lifjec'tive hijornidtioii is a way'of 
relating expenditures in . occupationa^ 
education to product. It is a very 
uncomplicated analytical intorniation 
type, but one which shoyld be of some 
yse fulness to management. In MISOE 
there are a limited variety of prodjictivit^ 
descriptions: ^ 

1, Number of completors. Some programs are 
more productive -than others in that they 
produce mpre* completors at a tlxed cost. 
'2, Niimher of TERAIGBS achieved per 
completer. Home occupational education 
programs- are more productive because 
^ ^ they produce liUjie s tudents who have 
achieved more TERM()BS, c)n the ilverage, 
than another program, at a fixed cost, 

3, Quality scores averaged ov^r ^t^ompletors. 
^ome occupational education programs, are 
more productive because they^ produce 

f ^udents who have achieved higlier scoris 
on TERMOBS than students from another 
program, at a fixed^ost, 

4. Geneitt Educational Development, Sojne*^ 
programs are, more productive because 

^ they produce students with higher scores 
on measures of^ general educational 
development than others, fixed costs. 



Cost etYectivLMiess information must 
C(»ntrx)l tor input variability** itad is always 
framed to retlect a balance among 
productivity alternatives. In spite ot these 
controls, there seems to be a negative^ 
attitude toward the appropriateness ot 
such information for the management ot a 
human service like public occupational 
education, as it seems to smack ot an 
'^assembly Hne mentality." Nonetheless, 
educational management must frequently 
decide between process mixes, and one ot 
the criteria frequently ^sed is cost 
effectiveness. For example, given a tixed 
amount of capital, what is the optimum 
mix of staff and materials to graduate 
fifty, automechanics from a secondary 
program each year for the next ten years? 
Cost effective information in MISOE is 
designed to provide a clear de^j^ription of 
the relationships in occupational educa- 
tion between cost and productivity. 

Co.^t hnpact Information (cost benefit) 
describes relationships between the cost 
of occupational educational programs and 
the resulting benefits to society or 
specified individuals. It is an essential tool 
for selecting alternatives at several levels: 

1. Between public ) education and othec 
alternatives like health, -national defense 
and environmental control; 

2. For determining the mix between 
occupational and nohoccupation^J educa'- 
tion; and » 

3. For deciding among occupational educa- 
tion programs; for example, should society 
increase the number of automechanics or 
reduce the number of computer pro- 
grammers. 

Altliough the development ot cost 
benefit ratios involves^ the use of 
econometrics and an understaifding 
of several economic principles (none 
very difficult),/ the management 
implications of co^t benefit ratios are 
straightforward. GciaLs (bene tits) are 



specified and quantified in dollars, while 
the costs of alternative , programs to 
achieve these goals are calculated, and 
thus cost benefit ratios are formulated.. 
For example, if a goal of education is to 
• produce completors who pay maximum 
taxes, a societal benefit, a cost benefit 
analysis would rank order educational 
program alternatives in terms of the 
favorableness of their cost benelv ratios, 
with benefits the summation of total 
taxes paid over a prescribed num^r of 
years, and costs the total puWic,^ 
expenditure for the educational program. 
The higher the evaluation of the ratio, the 
better the investment, in terms ot that 
bene fit!» i.e. benefits over costs. 

Co.s'f Impact Information provides an 
equivalent of a system of market 
principals for investment*^ in social 
agencies, and represents a crucial 
information type of MISQE. As a, matter 
of fact, cost impact ' information is 
conceived, as the single most important 
information' type for the management of 
occupational education at tlie state level, 
as it is this information that provides the 
basis' of social investm-ent in extra cost 
occupational education programs. In fact, 
so-called marginal thinking, extra costs to 
extra benefits, forms the basis for 
investment in public education as it 
competes with other^ social agencies fot 
limited dollars to impact upon societal 
goals. A current criticism of public 
education is based on a .form of cost 
impact logic, and that is public education 
is not, contributing u'to equalising oppor- 
. tunities in terms 'of economic benefits, 
consistent v^ith its promise, v^hile other 
4'orms of intervention to accomplish this 
goal ^of economic equality have been 
suggested (Jencks, 1972).. The economics 
of MISOE are discussed in more detail in 
Chapter 5. . » 
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MISOE rxattt^ystenls 

MISOE has two major data systeins: 
The MISOE, Census Data System (CDS) 
and the MISOE Sample Data Systems 

* (SDS). The basic distinction between 
these systems is that the Census Data 
System includes , basic descriptive in- 
formation about major components of all 
occupational educational programs, while 

: the Sample Data Systems -are detailed 
descriptions of a limited number of 
occupational education programs in a 
prescribed number of schools. These 
separate data systems are described ^in 
some detail in t^ie next two chapters, but 
several basic distinctions of each system 
will be set forth at this time, as a part of 
this overview sketch of the major com- 
ponents oi MISOE. 

CDS is comprised of that information 
management requires of each occupa- 

. tional education program to meet its basic 
•accountability responsibilities. This infor- 
mation includes enrollments wifhin 
occupational education programs, by 
grade, level (secondary, postsecondary, 
adult), "school type (comprehensive, 
regiotial vocational-technical^ etc.), by 
geograj}hic region, and by certain student 
characteristics (sex, rate, handicapped, 
etc.). In addition, CDS describes annual 
expendituj'es by school, occupational 
• education prograVn, as well as information 
about staff characteristics and space 
utilization by occupational education 
program. CDS is considerably more 
complex than it appears,. since it provides 
for integrated reporting of basic informa- 
tion for occupational and nonoccupa- 
tional education in a way that allgws for 
comparisons by these gross data 'among^ 
programs. 

Another important feature of CDS is 
the way in which it connects inforriiation 
fogether. Essentially. CDS is a crobS- 



sectional data system, with the school or 
program as a unit of analysis. Enormous 
development pains have been taken such 
that census information is maximumly 
crossed. For example, the reporting forms 
providii for crossing a description of 
enijpllments by grade and occupational 
education program. Frequently, census 
type information systems are designed 
such ' that management is limited by 
aggregation alternatives. It is not unlikely 
to find statewide census information 

/ systems from which management can 
either discover total enrollments in 
occupational education over all grades, or 
the total secondary enrollment by grade. 
Such data systems cannot cross informa- 
tion by occupatipAal program and by 
grade. MISOE CDS Was carefully designed 
to avoid such limitations. 

CDS also * describes completors by 
TERMOBS achieved within occupational 
education programs. This is conceived as 
ait enormously useful management tool. 
TERMOBS are discussed in some detail in 
this chapter, ^ and the description of 
completors by TJ^RMOBS within occupa-" 
tional*education programs is described in 
Chapter .3. 
. SDS is divided into two subsystems, 

^ described as SDS(l) and SDS(2). SDS(2)^^ 
includes only the secondary sector of - 
occupational education, and is limited to 
the nineteen high enrollment programs 
^ (accounting for about eighty per cent of 
the .enrollment within Massachusetts at 
the secondary level). SDS(l) includes a 
number of additional occupational educa- 
tion programs tc those of St)S(2), as well 
as students from* the postsecondary and 
adult levels. Also included in SDS(l) is a 
sample of students at the secondary level 
who are not enrolled in occupational 
education. The purpose of including a 
nonoccupational education cohort is to 
provide a basis ^for comparison to the 
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extra cost i)Ccup;-tioiial education pro- 
grams in ternib i)t both products and 

/ihipact. • 

SI)S(2) information includes a descrip- 
tion ot input, prt)cess, product*' and 
impact, while SIXS(l) is limited to th> 
input battery, the impact battery, 
minimum product-data, i.e., completion/ 
nonconipletion, a measure of general 
educational development at the secondary 

. and , comnmnity college levels and 
expenditure information. Put another 
\vay, process information and TERMOB 
test data are not included in SDS(l). 
EsslMitiaJly, this means that process- 
product an*d cost eHecfivene.ss analysis are 
possible tor wSDS(2),'' while cost impact 
analvsis is available for both SDS(2) and 
SI)S(l). 

Chapter 6 describes how Census and 
^Sample Data Systems are connected 
together tor interactive use by manage- 
ment. An' important part of MISOE 
development has been the creation of a 
technical capability to connect all data 
files together tor interactive file browsing. 
This is a result of a- complex system of 
classifying and identitying data. Tliert is 
no attempt to swerve into, a technical 
discussion at this point, but it somehow 
seems reasonable to at least acknowledge 
the development effort of the MISOE 
staff. 

I 'Sdi: (i :oTk\< 

A"^ preliminary discussion of USOE * 
Codes (Vocational Education and Occupa-' 
tionSf r.'.S\ (lovenimcnt Prhithig ()fjict\ 
1969) is necessary background ta ix 
description of TERMORS. USOE Codes 
provide a numerical classitication system 
for occupational educafion programs. 
USOE Codes have two numbers to the left 
of the decimal and up to eight numbers to 
the right. The numbers to the left of the 



decimal specify brt)ad occupational areas, 
tor example, health occupations, otfice 
occupations, trade^ and industrial occupa- 
tions. As one moves to the right l:rt)m the 
decimal' ntimber, more t)ccupational 
speciticity is obtained. For example, 
14.000000 is the USOE Code for all 
office occupations,^14.0102 describes 
Bookkeepers. 

USOE Cl)des provide occupatic^nal 
descriptors tor occupational educatit)n 
programs, and are a basis tor describing 

♦ students 'enrolled' in' programs. Fre- 
quently, stud(?nts are enrolled in prt)grams 
which can be desci'ibed by more tlian one 
USOE Code, and completors otten attain 
a contiguration ot entry level occupa- 
tional capabilities in more than one 
occupational area, as described by USOE 
•Codes. Obviously, USOE Codes provide 
an important identitication component of 
the MISOE information svstem. 

TERMOBS' (describes below) ' are 
.conceived as descriptors of occupational 
capabilities, and MIS()E provides a 
mechanism such that completors of 
occupational education programs can be 
described by the configuration of 
occupational capabilities acjneved within 

' occupational areas as described by USOE 
Codes. The reporting process is explained 
in a little more detail j^^n the following 

, chapter, but the important understanding 
at this point is that MISOE provides a 
structure tor each locifT^ educational 
agency (LEA) to describe its completors 
in terms of the occupational capabilities 
:(TERMOBS) which represent the con- 
figuration ot entry ^level occupational 
capabilities deemed appropriate by that 
institution. Classification of occupational 
education completors on a'CDS bitsis by 
USOE Codes and TERMORS' provides a 
basis tor detailed analysis between 
occupational skills attained and career 
history* In addition, such intormation 
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^r<jyjdeii,.4^'cJ<3ar set of instructional goals 

■:'*j(One final point needs to bo made about 
USOE Codes, before a brief description of 
TERMOBS is 'presented, which is that 
although thev provide coded occupational 
descriptors tor instructional programs of 
cfccupational education, these occupa- 
tional descriptors are often different than 
specific job titles\Usually a USOE Code 
includes a variety of speciHc job titles, for 
example the 'uSOE Code 17.3601 
describes Millwork and Cabinet Occupa- 
tions, which can include the following 
-specific job* titles: Cabinetmaker Fore- 
man; Cabinetmaker; Refrigerator Cabinet- 
maker; Cabinetmaker Apprentice; Mold- 
ing Sander; Multiple-Drum Sander; 
Stroke-Belt-Sander Operator, etc. 

Vocational li^iicatiou and (kTiipations^y 
(USGPO. 1969), provides a basis for 
crossing US(^E Codes and job titles of the 
Dk'tionary of (kxiipatiojial Titles, MISOE 
provides a basis for describing a completon 
of an occupational education program in 
terms of specific capabilities, within an 
occupational area designated by a USOE 
Code or Codes. Tln§\information is basic 
to relating occupational education to the 
world of work by specific occupations, 
while not constraining open systems for 
occ-upational eitatation. These distinc- 
tions are important to users ot MISOE, 
particularly for program planning pur- 
poses. ^ ^ 

TliRMOBS 

TERMOBS are performace objectives 
which are purposefully comprehensive, 
that is to say they describe substantial 
occupational capabilities. They have been 
designed to provide a description of the 
pe^f^)rmances' which describe occupational 
competence within one or several 
occupations. TERMOBS include the three 



components of the chissical performance 
objective; 'I1ic coficlittons or the equip- 
ment, > machinery and supplies that are 
required for* the execution ot the 
performance; the perjonnauce or a. 
statement of what tli*e completor is 
expected to be able to do; and the extent^ 
or the criteria against which the 
performance is to be evaluated. It is 
important to understand that TERMOBS 
are limited to describing the occupational 
competency of completers of USOE 
coded" occupational* programs, and are not 
to be confused with so-called enabling 
objectives which describe the results of a 
learning task. Each USOE^^coded"^ 
.occupation is descrij;)cd •by^'UBout sixty 
separate TJgRMOBS!, which are sufficient 
tp.^^pcCtfy the occupational capabilities of 
completers. TERMOBS.;ar^ limited tO the 
psycliomotor oriented outconxes of 
occupational education and^ do not treat 
affective g'oals at all. 

Figure 2 presents- a typical TERMOB 
describing the format of the TERMOB 
and provides a basis for understanding 
their use in MISQE. . 

The conditions, performance and 
extent of each TERMOB are flexibly 
"organized, so that each school can 
stipulate the particular cgmbination of 
conditions, performances and extents that 
seem appropriate for their students. The 
performances are coded so that 2.01 
always describes a general statement of 
pertWmance and the resulting product or 
^service. Specific procedures associated 
with the general statement of per- 
formance are coded, from 2.02 to 3.00 
and are numbered seqiLntially to relate 
each procedural step to\i corresponding 
extent. Although the steps (procedures or 
operations) are listed in the order in 
which they are to be performed, it is 
possible for the faculty of a local school 
to alter the performance sequence by the 



FIGURE 2 
A TYPICAL MISOE TERMOB 
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1.00 CONDITION 

( ) 1.01 Single-State Common Emitter Voltage Amplifier With Bias Stabilization 
( ) 1.02 Schematic Diagram ^ ' . 

(.) .1.03 List of Fomulas^Tabtes, Graphs^ Etc. ^ ' . 
( ) 1.04 Basic Electronics Took Kit (Appendix 1) 
( ) 1.05 Oscilloscope 
( ) 1.06 VTVM. 

( ) 1.07 VOM (Conventional/Digital) 
( ) l.OS ^wer Supply 
, ( ) 1.09 Signal Generators 
( } 1.10 Frequency Counter 

2,00 PERFORMANCE v 



General Statement of Performance and Resulting Outcome 

{ ) 2.01 Test a Single-Stage, Common Emitter Voltage Amplifi'er with Bias Stabilization 
to Determine Circuit Characteristics Employing the Following Operations: 



) 2.02 Select Proper Test Equipment 
( ) 2.03 Check and Zero as Necessary All Test Equipmpjit Us^d 



( ) 
( .) 
( ) 
( ) 
( ) 



2.04 Determine Voltage Gain 

2.05 Determint Input/putput Impedance 

2.06 Determine High/Low Frequency Cutoffs 

2.07 Determine Power Gain 

2;08 Determine Frequency Response Curve 



3.00 EXTENT 



General Stdtement of Extent and Extent of Resulting Outcome 

( ) 3.01 Following Proper Procedures and Safety Precautions to Approval of a Board of 
Expert Raters. To Be Completed Within Two Hours With Eacli Step Judged 
As Satisfactory or Unsatisfactory 



i ) 
( ) 
( ) 
( ) 
( ) 
( ) 
( ) 



3.02 Of Sufficient Sensitivity and Characteristics To Produce Significant 

3.03 In Accordance With Manufacturer's Procedures 

3.04 Theoretical Value ± 20% 

3.05 Theoretical Value ± 2b% . . 

3.06 Theoretical Value ± 20% 

3.07 Theoretical Value ± 20% * ^ 

3.08 Theoretical Value ± 20% 



lues 
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reporting process^. Further, the reporting 
process of TERMOBS allows for LEAs to 
specify additional coivditions or extents, 
accept or reject TEKJMOBS altogether, or 
specify TERMOBS not included in the 
MISOEfile. ' 

In summary, TERMOBS represent a 
process for reporting the occupational 
capabilities of program completors which' 
does not restrict the range of program 
objectives, but is flexible and open, 
without sacrificing specificity. In MISQE^ 
CDS, each occupational department in 
each school describes enrollment by 
TERMOBS, within USOE Codes. No 
testing of students against locally opted 
standards is included in the MISOE-CDS 
design. In SDS, however, students are 

tested agains^ J^^^^ criteria (criter ia 

referenced testing), and quaTiJty s^res are 
developed on a one to five scale, with a * 
score of less than two a failure. This 
publication will not stipulate TERMOB 
data in detail, , except to say that^ it 
includes a form of item analysis which 
rank orders T^ERMOBS by their, level of 
difficulty as determined by the compara- 
tive performance of sttidents. The MISOE 
stafif proudly feels tliat^ TERMOBS 
represent an 'important development, in 
that they provide a basis for evaluating 
dccupatiqnal education prQgrams in terms 
of achievement, without forcing constant 
standards across prograjns. 

The following are the occupational 
areas for which TERMOBS have been 
developed: 

r. Distributive Occupations 

2. Practical Nursing 

3. Occupational Child Care 



4. Accounting and Computing 

5. Business and Data Processing 

6. Filing, Office Machines and 

General Office Clerical 
* 7. Stenographic, Secretarial Occupations ♦ 

8. Automotive Body and Fender 

9. Automotive Mechanics 

10. Drafting 

11. Woodworking - 

12. Electrical 

13. Electronics 

14. Plumbing and Pipcfitting 

15. Graphic Arts 

16. Machine Shop • 

17. Metal working 

18. Cosmetology 

19. Quantity FQods . / 

Each of the occupational areas 
stipulated a bove represents a wide variety 
of specific occupations. 

Conclusion - 

The basic distinctions and definitions 
stipulated in this chapter provide a 
necessary and sufficient background for 
an overall understanding of the structure 
of MISOE information systems. How- 
ever, in order" to use the indices and be 
able to work through ' the example of 
Chapter 8, it would be helpful to have 
more informtttiiiin about iflie Census and 
Sample Data Systems, the MISOE cost 
systems, and at least some idea of how the 
'data within the MISOE file system is 
•structured. It is suggested that the casual 
reader at least skim ^ the next four 
chapters, before studying Chapters 7 and 
8 in detail. 
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CHAPTERS 
MiSOE CENSUS DATA SYSTEMS 



I 



Martin Breslow 



The purpose oi this chapter is to 
describe the important informi^tion types 
of the .MiSOE. census data systeifis 
(MISC)E-CDS). MISOE-CDS is comprised 
,oi information describing a few charac- 
teristics of each institution offering 
occupational education. The few charsic- 
teristics include the minimum intormatic\i 
required tor the statewide managemc^it (jii 
occupational educatioii, e.g., enrollments, 
expenditures, etc. Tils descriptive infor- 
mation provides tli^^. ba.sis for com- 
municating the statewkL* scope of 
occupational education in terms of tliescv 
fundamental, few characteristics. 

MISOE -CDS has been carefully 
designed to offer a census level 
description of a fluid and dynamic process' 
of public occupational education. It is not 
unusual to find census data systems 
widely regarded as simple-minded classi- 
fication schemes which are not capable of 
describing' th*e complexities of practice. 
MISOE-CDS was painfully designed to' 



ijv; 



accommodate wideyvariations in reporting 
occupational education practice terms 
of these few cliaracteristics. The structure 
of MISOE-CDS is designed to encourage 
varia^on, and not to penaHze innovation 
with an over-structured reporting system. 
This is an important development, given a 
desire to initiate and irmaintain an 
information base for statewide planning in 
occupational education which is based on 
accurate information. 

Occupational education is part of total 
education, and a census data system 
Jihould allow comparisons between occu- 
pational and nonoccupational education 
in terms of these few characteristics which 
constitute the census diita system. 
MISOE-CDS has been designed ^uch that 
it is integrated witli the existing data 
systern for total education, thus providmg 
iX single reporting package to local School 
districts. 

* Although MISOE-CDS was difficult to 
develop, it is relatively uncomplicated to 
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describe and 'should provide no difticulty 
to either the casual or cai-etul reader. This 
chapter brieHy outlines 'the important 
inTormation types of MLSOE-CDS as 
follows: 

1. expenditures; 

2. enrollments; 

3. TERMOBS; 
♦ 4. stafh and 

5. in.structit>nal area. 
The process for developing expenditures 
by occupational education programs from 
CDS in'format^on is described in Chapter 
5. It is important to understand that the 
MISOE census data system has beeji 
purposefully de>igned to allow maximum 
flexibility and interactive analysis. 
Chaptt;r 6 details the connections between 
MIS()£ cen;ius and sample data systems 
for interactive analysis^ and both Chapters 
5 and 6 indicate how MISOECDS 
expenditure information is used as a basis 
for e^stimating costs in the sample data 
systems. 

A final introductory note to this 
chapter is to restate (C:hapter 2) 'that 
MISOE'CDS was developed to maximize a 
cross-connection of data m^^ie reporting 
forms. This is c^ssential to provide range 
for interactive analysis with the MISOE 
census tlata system. FrequtintK\ statewide 
census information* systeriis arc little .more 
than a series of individual and 
unconnected reports grown frcnn a variety 
of laws affecting public education. As a 
result, such ^'mandated information'* 
census information systems are not 
organized as a part of a total management 
information system, vital to- statewide 
planning for education, and are ottcn 
regarded as a burdensome administrative 
chore, totally unrelated to the imaginative 
function of educational management.^ 

lixpoiditiirc Data 

-Cost *in formation, is a vital descriptive 
characteri.stic for the statev^ide manage^ 



^nient of occupational education. Accord- 
ingly, MISOE-CDS provides cost informa- 
tion, at the LEA, the school and the 
individual occupational education pro- 
gnAn level. MISOE-CDS cost, data is not 
limited to a t(3tal cost for a program, but 
is available by a wide variety ot 
descriptors within the total cost function, 
for example, staff, instructional materials, 
etc. 

Cost data at the school levelallows the 
•comparison of the per pupil expenditures 
for occupational and nonoccupational 
education level (secondary, post- 

secondary-'uiid adult) and by school type 
( sel f contained antl comprehensive 
scliool). The cost associated with the^ 
-nonoccupational education program of 
students enrolled iix occupational educa- 
tion is an available cost information type 
within MISOE-CDS. Put another way, the 
cost x)f educating- an occupational student 
can be divided into academic and 
occupation*!^ education components. 
These comparisons arc important since 
one alternative to spending money in 
occupational education is spending money 
on nonoccupational education. This 
informayon is especially 'significant tot 
the managenient for self-contained occu- 
pational' education schools. 

Management also needs to know how 
occupational education costs vary by 
school. type. CDS school types include the 
following distinctions; 

1. Comprehoisive Secondary Schooh - 
Schools in which studentb are enrolled in 
both occupational and. nonoccupational 
education. * 

2. SelfContained Secondary Schools - 
J Schools in which .ill students are enrolled 

in occupational education. 

3. Academic Secondary Schooh - Schools in 
which no students are -enrolled in 
occupational education. 

4. Two^ Year Colleges 

5. Other Institutions 
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Secondary schools can be classified as 
regional dud noni;egional, wliile»all schools 
can be classified as public or private. Cost 
data can be classified by USOE codes, 
across schools and regions. Expenditures'* 
by federal, state and local governments 
are also separately * identifiable by 
program, school and LEA. Sinc^ dropouts 
and transfer-outs increase the average cost 
of program cpnipletors, CDS provides a 
basis for estimating cost per completor 
and cost per dropout for each program. 
, Considerable detail on the MISOE cost 
analysis system is providefl in Chapter 5. 
Consequently, this . discription of the 
expenditure information in "QDS is 
abbreviated**?' 

Enrollment Data 

The statewide management function 
for occupational elducation needs to know 
the real enrollment of students in LEAs, 
schools and individual occupational 
education programs within schools. 
Reporting enrollments at the LEA and 
school level is a relatively straightforward 
matter. MISOE-CDS describes enrollments 
by LEA^i by grade and sex for each school 
and for occupational and nonoccupational 
education. Individual school enrollments 
in nonoccupational and occupational 
education are available by grade, race and 
sex. In addition, MISOE-CDS provides a 
description of the number of completors 
of occupational and nonoccupational 
education by level (secondary, post- 
secondary and adult), race and sex. Thus, 
the statewide management function can 
determine the proportion of completors 
by level and type or education* 

Describing enrollments for occupa- 
tional, programs in a way that reflects real 
life -variation is a more complex matter 
than merely describing enrollment above 
the individual program level. In some 



programs students are being prepared for 
single occupations. In others, they may be * 
•le.arnirtg occupational skills for several 
occupations at the same time. In still 
other instances, students may be receiving 
training for several occupations in the 
early phases of a program, ^but specialize 
in a specific occupation toward the end of 
the program. 

In order to be able to stipulate each of 
.these variations, CDS provides for 
describing enrollments by USOE codes 
vdthin each, grade. Students in a program 
who are in the Same grade and who are 
being prepared for an occupation 
described by the same USOE code or 
codes are considered to be Enrolled in the . 
sam« ^'student group". The enrollment in . 
each student group is available by racf 
and sex, as well^ as student type (dis- 
advantaged and handicapped). 

At the end of the school year the 
number of students in each group ^^^l ig^ 
are: 

L continuing or graduating; 

2. repeating; or 

3. transferring or dropping out arc described, - 
Thus, CDS provides the -state-level 
management function with a complete 
picture of the flow of students through 
the occupational education process, and 
at the same time provides a detailed 
description of enrollments within occupa- - 
Clonal education programs by USOE 
codes. 

lerniinal Objectives 

USOE codes describe broad occupa- 
tional areas, in otder to provide more 
useful information for the state-level 
management function in stipulating the 
specific occupations for which students 
are being prepared, CDS provides a 
process for specifying the configuration of 
TERMOBS (see Chapter 2) attained by 
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each student group, within each occupa- 
tional education pr^toram, for each school. 
Students in the^teud grade ot an 
occupational eduStion program are 
grouped together h^^d on the TERMOBS 
they l^we attained^ithiii student groups, 
previously described, ^^^s, if students 
within ^ single^ schooliiox* being prepared 
for the samjj^group of occupations but 
with di(fi^fmi sets of TERMOBS, then 
more than oiie group of completors exist 
for reporting*purposes. 

Each student group represents a unique 
combination ot USOE codes and 
TERMOBS. These* student groups are a 
data refine'ment of the student groups 
previously described, which included only 
a description ot students by the broad 
occupational areas for which they were 
being prepared. This grouping is available 
only for the final grade. 

Enrollment is reported for each of 
these final grade student groups by race, 
sex and, student type. With this data, 
MISOE-CDS provides the state-level 
management function with t(he capability 
of determining the specific occupations 
for which students are being prepared 
within each program. Furthermore, the , 
state-level management function can 
generate suntmary statistics describing the 
frequency with which specific TERMOBS 
are offered over programs, as well as a 
description of the. numbers of students 
prepiired with unique TERMOB combina- 
tions within occupational education pro- 
grams, as described by USOE codes* 

The MISOE Sample Data Systems will 
provide a ranking tor TERMOBS based on 
the performance of students over time. 
Through this form of item analysis, 
TERMOBS can be classified as not 
difficult, difficult, or very difficult. 
TERMOBS in the Census Data System * 
will be referenced with. this descriptor, 
and thus programs can be compared in 



terms of the difficulty level of TERMOBS 
offered. Such inforrnation might be useful 
as a^basi^ for explaining d^bpout rates, for 
iixampler • * ^ ^ 

Staff hiforrnation ' 

The description of the nunibei;^ and 
certain char-acteristics of^ faculty and 
administrators for occupational education 
is useful to the state management 
function. MISOE-CDS provides a descrip- 
tion of the occupational ^ucation faculty 
in a way that they can classified by 
student groups, i.e'., grade' USOE codes 
and TERMOBS (for completors)/The 
faculty can also be cross-classified by city 
ox town, LEA or school, as well as by race 
or sex. Administrators and nonoccupa- 
tional faculty are classified by . city or 
town, LEA and school. 'Thus, the manager 
can ed^sily determine the proportion of the 
state-wide educational ''staff involved in 
preparing students for occupational 
educadon in general, for specific 
occupations, by grade within occupiitions, 
or specified combinations of USOE codes. 

In addition to providing the description 
of the numbers of staff in a way that they 
can be aggregated by a variety of 
dimensions within occupational educa- 
tion, MISOE-CDS includes information 
which describes the salary, degree status" 
and work experience of the faculty for 
occupational education. This intormation 
is coded and connected such that it can be 
summarized and/or compared across 
grades and USOE codes within occupa- 
tional education. For example, manage- 
ment at the state level can determirie 
(interactively) if the faculty differs 
significantly by age, teaching experience 
or salary across occupational education 
programs. 

%4 
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liLstructunijl \rca 

f(n important educational resource is 
tiiC instructi()nal area, i.e., the classroom, 
thei^jj^ui the shop^wdthin the particuhir 
scho(»L This resQiirce is rehitively Hxed 
and high Ct)st, and it is particularly 
important that* it be used etHciently. It is 
therefcyre dcbireable that tlie state-level 
manaaumeiit Kinction liiive information 
descrvtTtJig ihc way in which occupational 
education instructional 'areas are used 
^ImnigU^it tUe ~ sclu'>al — year-, — l-nst4^u:- 
*tiou:il space in occupational education 
is also important tor allocating certain 
t^ducational costs to specific occifpa- 
tional educijtion programs.. Thus, an 
important , part of tjie MISOE-CDS 
mh>rpiation sy,s|^em is a description ot 
the instructional areas used tor occupa- 
tional education, 

MLSOE-CDS information provides a 
description ot the amount ot space that is 
actually in use time ot day and by 
speciHc occupational education area 
(USOE- code(s) }, This information 
includes both tloor space area and .work 
stations. Instructional space is also rated 
in terms of its suitability as an instruc- 
tional station f^^r specific occupational 
areas. - . " 

With this information, the state-wide 
management function can maintain a 
running inventory ot available space tor 
expanding occupational education pro- 
grams, not only as a total, but tor specific 
occupations in specified geographic 



locations. For example, management can 
deternune (interactively) the ,numb,er of 
available learning stations tor preparing' 
automechanics in cities, during (1) the 
regular school year, and (2) during the 
summer months, ^ 

Cojiclusion 

MISOE CDS information is not com- 
plex in terms of the variety of major 

ini4^mimon-4:^^^s-^roJAde-d^^4 ndiu«^^ - 
enrollment, staff^jid instructional area), 
and therefore should present no difficulty 
to the reader. The cgmplcxity of 
MISOE-CDS is caused by the range of 
observation units (every program) and the 
resulting data ' landslide, as well as the 
necessity of connecting and crossing this 
information for interactive analysis. 
Chapter 7 describes the user indices 
MISOE-CDS data, files for interactive 
analysis, ^ 

Tlie next chapter describes MISOE 
Sample Data Systems, which constitute 
the major information bases for policy 
formulation. However, the process of 
policy development usually involves a 
need to know certain dimensions of the 
state of the real 'orld, and therefore 
knowled|;e of the intormalion com- 
ponents of MISOE-CDS is important, Tjie 
advantage of crossing MISOE-CDS and 
SDS files during interactive policy 
formulation should be made obvious by. 
the example presented in Chapter 8, 
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CHAPTER 4 
MISOE SAMPL^^DATA SYSTEMS 



J(^in A. Creager, HlizabetlifWeinberger, ^ 
and William G. Conroy, Jr. 



The sample data systems of MISOE 
provide ipanagement witli^ most of ithe 
information necessary tor policy develop- 
ment in occupational education. Infotma- 
tion of the sample data systems provi'd^s 
the basis for assuming causation relation- 
ships between process and piojuct, af^ well 
as describing the relationship between 
differential levels , of achievemerit by 
students and the resulting impact on both 
society and the individual student. Since 
it is necessary for management to have a 
reasonably firm understanding ot the basis 
for policy formulation as supported by 
the MISOE information systems, a fairly 
thorough description of the sample data 
systems wil! be prcbciited 'in this cl^ipter. 

The text of this chapter assumes an 
•understanding of Chapter 2, affd'will not 
repeat any of the definitions and distinc- 
tions otYered in that part of this publica- 
tion. Tli'is- cl^apter is divided into four 
parts, and they are: • 



1. A description of the samplKjand research 
design of the MISQE sample Idata systems, 
including a specificaHV^of the size of the 
sample; 

2. A comprehensive outline of the variables in 
each of the IPPl components of MISOE, as 
well as the rationale for their selection; 

3. A br,ief statement about the MISOE 
security saleguiird system which is 
designed to protect tKe privacy of subjects 
>Ln the sample data systems; and 

4. Examples of generated variables (Gen 
Vars}. an important part of understanding 
the scope and power of MISOE sample 
data systems. • 

The MISOE sample data system's are 
not considered an exhaustive list ^of 
potentially significant variables within the 
IPPI elements. Nowhere is this more 
evident than within the process com- 
ponen^j However, it was necessary to 
attaio (Closure, such that initiation of tlte 
first cohort could be achieved. The sample 
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data systems descr^ibed below are thought 
of by the MISOE staff as first generation 
MLSOE, Wkh the obvious expectation thvk 
those who follow this pioneering effor\ 
will improve upon the first generation 
range of .yariabks. Nonetheless, the 
MISOE sample data systems are offered as 
a reasonable iufbrmation basis for policy 
formulation in occupational education at 
the state level. - . ' 

As managers explore the experience of 
occupational education as described by 
-tlie sample -datar^y^t^^Br^s-fcam-tbe-perspec--- 
tive of current policy needs /or future 
programs, it is hoped that neW under- 
standings will be launched which will 
make demands for different information 
in future MISOE generations. In . the 
meantime^/ the MISOE sample data sys- 
tems described within this chapter set 
boundaries of alternatives for policy 
development with MISOE. The sample 
data systems constitute a major part, of 
the range of symbols which are available 
for* computer assisted policy making in 
occupational edu^iation. 

Sample and Research Desij^ji of the 
Sample Data Systems 

' ■ ' f "■ 

Occupational education is not just a 
production line for gadgets per unit of 
time, biit a complex process of human 
development with wide ranging social 
consequences. The sarnple data systems 
are designed to provide a rich information 
base necessary to understand the likely 
consequences of policy alternatives for 
complex human beings. To keep a system 
of (\i^ti^ collection, storage, analysis and 
retrieval manageable under logiiitic *and 
cost constraints, die information describ- 
ing the characteristics of occupational ' 
education programs, the students served, 
the capabilities achieved and the social 
impacts oFthe students over future-time is 



developed on a sample, rather than a 
census basis. It is for this reason that 
saniple data systems have Ueen so named. 

The sampHng design for ^ MISOE 
sampling data systems (MISOE-SPS) was 
developed to attain a probability sample 
for occupational education within a state 
which is of sufficient size to pc^rmit 
scientifically viable samples of students, 
teachers and j^dministrators within and 
among occupational prognims, as well as 
for a comparison group' of students who* 
-did no t r -ecei ve Q cc ;u patiaaaI--educa4;iQn^ 
Furtlier-, the sample has to be sufficiently 
flexible lo^ allow analysis to be targeted 
upon specific levels, e.g., secondary, post- 
secondary and adult, or for programs 
within levels, for example, automechanics 
or data processing. 

A two-stage sampling design has been 
adopted. At the first stage, schools are 
taken as the primary sampling unit and' 
are stratified disproportionately into 
twelve strata.lEach strata is defined by 
type of sVhoolv and community size, as 
shown in Figure 1. 

With ^comprehensive schools defined as 
schools which include students enrolled in 
both occupational and^ nonoccupational, 
education and self contained secondary 
schools including only students enrolled* 
in 'occupational education, schools were 
selected in each strata by recourse to a 
published table of random numbers. A 
varying sampling ratio fi:om six to 100 per 
cent was used, depending upon the distri- 
bution of schools in the . population in 
each strata^ It wasldecided that each strata 
should be large enough to allow represen- 
tation of all the occupationa^l education 
programs at all levels. However, to accom- 
plish this a collapse of strata was neces- 
sary as shown in Figure 2 for small 
enrollment programs at the secondary- 
level and all adult and postsecondary level 
occupational education programs. 
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FIGORE 1 
MISOE-SDS STRATA 



Comprehetisive Schools 

Cities and Towns 

(1) 75,000 or Greater 


Self Contained 
Vocational-Technical Schools 

(2) 75,000 or Greater 


# • 

(3) Three Largest Cities 
in Massachusetts 

V ■ 


(4) Three Largest Cities 
in Massachusetts 

• 


Cities and Towns Between 
(5) 10,000 and 75,000 


(6) Cities and Towns Between 
100 and 75,000 - 


(7) Towns of Less Than ^, 
* 10,000 


(8) Towns of Lt 
10,000 




(9) Regions 


(lOJ /Regions 




Cellll 

3 Community Colleges 


Cell 12 

3 County A[i 


-icultural Schools 



FIGURE 2 

STRATA COL|.APSE FOR SMALL ENROLLMENT PROGRAMS. 





Com]^rehensive 
Schools 


'Self Contained 
Vocational-Technical Schools 


Cities and Towns of 
75,000 or more * 






Cities and Towns of 
lesffthan 75,000 
including regions) 
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Before moving on .to the second stage 
of sampling, it is important to ui;derstand 
relationships between the occupational 
education programs iiT the sample data 
systems, the strata design of the saitiple 
data systems, and: the information dif- 
ferences between the samplq data, systems, 
i.e., SDS(l) .and SDS(2). These programs 
are as follbws: ' 

X, SDS(l) iF}ciudcs occupational education 
programs at the secondary. level which have 
small enrollinent; occupational education 
programs at the postsecondary and adult 
leycls; and a nonoccu'pational education 
ccJMparison group at the secondary and 
corrimunity college levels. These programs 
: are ns follows: ^ 

SECONpARY . 

"Agriculture Production" 
Ornamental Agriculture 
^ - Auto Body * 
^ Cosmetology 
Commercial Art 
Plumbing and Pipe fitting 
Care an4 Guidance ofecliildren 
Consumer "Hbrriemaking 
Metalworking 

POSTSECONIJARY 

Community College^ Non-Community College 
Associate Nurse Dental Assistant 
office Edura^^v^1 Practical Nurse . 
Electronic Technology 
Electrical Mechanical 
Technology 

ADULT • • 

'Supple rnental Preparatary 

Office Education Office Education 

Fire and Safety Distributive Education 
Technology Apprentice . 

Fireman Training Carpentry. 

Police Science Plumbing and 

Technology Pipe fit ting 

Quantity Foods Metallurgy 
2. SDS(2) ijpcludes only occupational educa-^ 

tion programs at the secondary level and 



^ all IPPl information types. These occupa- 
tional programs are: 

SDS(2) Programs ■ ^ 

1. Distributive Education 

2. Office Education Programs 

3. Automotive Mechar^ics Programs 

4. Millwork and Carpentry Progranis 

5. Electronics Programs 

6. Electrical Programs • " 

7. Drafting Programs **^:■\ 

8. ^ Machine Shop Programs j 

9. Graphic Programs 

J 10. Quantityjpbods Prpgrams 

From an infStfB^ition perspective, 
SDS(l) pccupatipnaTt ^j^ograms at the 
secondary level do not ' include process 
and TERMOB inTormation. No process 
information i^ - gath'ered , for ^the non- 
occupational education : corrv^arison 
group. However, 'the input and impact 
battery for these groups is exactly ^Uke 
that of SDS(2), and expenditure infdrma- 
tion and the estimation of general educa- 
tional development is included in »felie data 
file. Postsecondary, commimity • college' 
programs include the same data types as 

^secondary 'SDSfl) programs, while stu- 
dents of postsecondary, non-comhiunity 
college programs and adult programs', are 

•measured by a -special input battery, and 
there is no measure of general educational 
development included, it should be noted 
that some programs occur at different 
levels, for example office education and 
quantity foods. In total, there are forty 
schools in the MISOE sample data systems 
in all* strata, and all information for all 
levels and programs is gathered within 

.these schools. There are about 15,000 

'students in all sample data systems, with 
approximately 6,500 in SDS(2) and 8,500 * 
inSDS(l). 

.The first stage sampling weights to be 
applied to sample data in estimating pop- 
ulation parameters are simply inverse 
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sampling, ratios. These, however, vary hy 
program diul k*vel, becau,se not all sch(n)ls 
in a stratum t>tYer all programs at all 
levels. 

The second state oi sampline is^to be 
accomplished within the schools selected 
by the titst stage. All administrators and 
teachers assf)ciated with the SDS(l) and 
SDS(2) programs in a sampled sphool are 
expected'to' participate in MISOE. For the 
sampling of administrators and teachers, 
the secioncT stage weights are expected to 
be very close to unity. Entry level stu- 
dents in each ' relevant program are 
yi^npled at varying ratios, with ,\yeights 
j equal to the inverse of the sampling ratio. 
The pattern of sampling ratios is con-^ 
strained by the total amount ot testing 
that can be arranged at reasonable cosjs 
for^all schools and programs. It turns out 
that 100 per cent sampling is possible tor 
students entering' a program within a 
school up to an enrollment of about 
thirty students. Beyond that level, the 
sampling ratios drop oft accordingly. It 
should be noted that most analysis will be 
based on aggregates across sampled / 
schools and then across strata so that the 
samples on which particular analyses are 
based will be of sufficiently rlarge size to 
ensure reasonable precision in aggregate 
estimates of population characteristics. » 
However, with fixed logistic and cost . 
constraints, MISOE has opted to trade oft 
some precision' in order to obtain its 
richly varied informatioji base. 

The weights •actually apphed to student 
data j[or computing aggregate estimates 
anfd for: couducthig analyses relevant to 
the population will be the product of the 
first stage and second stage weights. Given 
the probability sampling . design, these 
weights produce statistically unbiased esti- 
mates of aggregate population character- 
istic's. Such inferential statistics will, how- 
everiibe subject tq considerable amounts 



o( sampling error. , ^. 

•'lieeause MISOE has decided upon two- 
st.ige .sampling with disproportionate 
stratification, tlie typical formulae for the 
standard errors of commonly used statis- 
tics, e.g., the standard error of a mean* or 
percentage, are hot applicable. The appro- 
priate f(^rnnilac ^ art known ♦for some 
iiggregate statistics, but require special and 
costly computer software development to 
make them available in a systematic way. 
to the interactive user of the system. The 
user will not be overly concerned by these 
technical considerations, nor should he be 
so distnicteJ. Rather, he may be expected 
to torus interest pn substantive inter- 
action with the data base to generate, 
develop and test policy-oriented ques- 
tions. Never^ieless, MISOE plans, as a 
part of its own administrative and quality 
control responsibilities, to compute esti- 
mates of precision in its a^regate statis- 
tics 'for some extreme and typical cases. 
MISOE recognizes its scientific responsi- 
bility to report such information in the 
appropriate technical journals. 

It should' be noted that if higher preci- 
sion is desired, it can only 'be attained at 
cohort replacement time and under either 
or both of two conditions: 

1. More fvind^ are available to permit testing 
and ^luce^smg data' for larger samples; or 

2. Sufficient analysis has been accomplished 
to indicate which factors now measured in 
the data base are unprtedictive of educa- 
tional quality and impact or are redundant 
and can be eliminated from the data base. 

The sampling and weighting considera- 
tions just described are subject to certain 
adjustments "tor logistic problems that 
ijievitkbly arise in a* program of this 
magnitude. Allowance iiAs been made in 
MISOE development for detection and 
treatment of such problems. Much more 
important is the fact that additional 
weighting factors are required for repli- 
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cated impact measurement. This arises 
because the students are no longer under 
the jurifidiction o( the school^aud must be 
cpntacted by mail. Because respoonse to 
mail surveys is not a random process, the 
additional weighting factors must do 
double duty; adjust aggregate counts for 
the amount of nonresponses, and correct 
for the bias due to nonresponse. For- 
tunately, MISOE will have extensive in- 
put, process, and product information in 
terms of which respondents and ndn- 
respondents can Ije compared. Given this 
information, weights can be developed 
based either on actuarial tables defined by * 
such variables contrasting the two groups, 
or on regression estimates of the prob- 
ability of response, given, the character- 
istics of individuals in thc^ jhailout group. 
The weights are functions' of reciprocals 
of such estin^^red probabilities and are 
applied to the records of the respondents. 
For inter-element analysis, the impact 
response weights can be multiplied by the 
tWo-stage sampling weights to derive the 
appropriate weight for representing the 
original cojiort populations. 

One of the features of the MISOE 
sample data systems Jsth^t the informa- 
tion retrieved by manager will have 
been weighted in such a manner that it is 
applicable as estimates for the populations ' 
of students and programs in which he is 
interested, rather than only for the 
samples. Thii is accomplished by a system 
o( posting the appropriate weights to the 
data files at data entry time. 

The research design of the MISOE 
sample; data systems is longitudinal. This 
means that sample cohorts of students 
entering the educational programs noted 
in the previous section are followed over 
time through the educational process, to 
becoming an educational product, and 
finally entering the social, economic and 
cultural life of American society and 



maTcing tlieir impact upon that society 
over time. Thus, MISOE sample data 
systems obtain extensive data on the 
input characteristics of students^ as well as 
on such measurable aspects of the educa- 
tional process as teacher and adrhinis- 
trator characteristics, physical environ- 
ments and instructional strategies. Then, 
MISOE m'easures the quality of the 
product with a unique combination of 
traditional and criterion-referenced 
measurement techniques. Finally, MISOE 
sample data systems obtain extensive data 
at subsequent points in~ time" ^1r~y ear, 5 
years, 10 years after program completion) 
describing on-the-job performance and the 
many aspects of the former student's life 
as a citizen. Such impact information also 
describes the return to society of its 
investment in the student. 

Tfic major advantage of a longitudinal 
.research *design is the connectability of 
th^ dataf pver time for each student in the 
sample cotK)rt, such that the complex and 
real-life protess is mirrored by the data 
system. ThusV analysis is not confined to 
within input, jpmc/ssN^roduct, or impact, 
but can also ^ecarriaci out across these 
elements, to ^describe tjie crucial relation- 
ships required for policy determination. 

An important feature of a longitudinal 
research design is that is allows analysis to 
account for individual differences. For 
example, students can be differentiated 
by a variety of input characteristics, and 
studied as they move through education 
and into society. These groupings caij be 
developed as a result of a differential 
impact or achievement. For example,' a 
manager might be interested irt' discov-' 
ermg if the cost of training for students 
who are of average intelligence but come 
from homes supportive of education is 
very different than students of average 
intelligence from hohies not supportive of 
education. 
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The major ■ disadvantage of a longitud- TH^ assessment design is pTrmarii^rDir 



inal design is the time requii;ed to obtain ^ 
complete iata across all elements tor a 
sample cohort. This design req^iires 
certain risks to be taken in regard to 
C€>ntinuing support conimitments. For- 
iunately, one does nqt have to wait until 
all the data are in to perform relevant 
analysis. Moreover, the apparent high 
costs of a longitudinal design are offset by 
the benefits of connectability as noted 
above. 

For instructive purposes, a brief com- 
parison with a longitudinal researclTdesign 
to two other design alternatives is now 
offered. These two research designs are 
called cross-sectional and assessment. 

In the cross-sectioiial design, the 'four 
elements (input, process, product 'and 
impact) would be separately measured, 
each vsdth a different sample cohort 
having passed through the system at dif- 

' ferent times. Not only is there no real 
connectability across elements, but one 
must make some dubious assumptions to 
the effect that there are no temporal 
changes in the culture that might effect 
different cohorts educated at different 
times, that one cohort is eqjiivalent to 
another in input charactepstists, and that 
all cohorts have experienced the same 
educational process. Also, if all fbur ele- 
ment's were measured on different cohorts 
at the same time, it would be very costly 
and very difficult (logistically) to obtain 
the rich variety of information on any of 
the four elements that is possible under a 
longitudinal design. Moreover, it should 
be recalled that some large and expensive 

• studies have been severely 'criticized for 
trying to jnake causal inferences from a 

- cross-sectional database.* 



cerned with ascertaining what progress 
students have made toward the attain- 
ment of selected educational objectives. 
Thus, **census-like" data Ire obtained on 
samples of such groups, usually focused 
on what MISOE calls . product data. 
Assessment is typically, not designed to 
evaluate the effectiveness of the educa- 
tional process, but usually, seeks to esti- 
mate educational attainments of groups of 
people. Therefore, in MISOE terminology, 



it gathe r s a n d s u mmarizes product data -^ 
with only a few demog?:a]phic character- 
istics (like age and grade level) to define a 
few subgroups of interest. Its data are not 
connectable. 

Like MISOE product data, assessment 
tends to' use criterion-referenced measure- 
ment of defined educational objectives. 
As diagnostically useful as they are, assess- 
ment data are highly restricted in their 
ability to aid management in policy and 
decision' making purposes. The longi- 
tudinal design includg the positive valu^ 
of both cross-sec ticMal and assessment 
designs, \fut provides a basis for differ- 
ential analysis, using the individual stu- 
dent as a^unit of analysis. A longitudinal 
research design reflects stages qf.growth 
for individual and complex human beings 
through life as a student and on into 
citizenship. Non-longitudinal ^search 
designs are severelyUmiting for interactive 
analysis and make it virtually impossible 
tCK do any analysis across elements'. The 
policy-making example of Chapter 8 
should make clear the advantages of a 
longitudinal research design in supporting 
an in t eractive information sy ste m 
designed ]to support policy formulation. 
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- St4t^izm'ztttti SpecijiL\itio } i of IPPi I 'arui hk'^— — 

('uHsidorablc detail provided in describing .the selection process (;t the input and 
proce-bs batjceries* as a way oF indicating the care with which MlSOE has been 
constructed. Less attention is paid to product .variables, as they have already been 
described. Impact is measured by tw<^ instruments, and therefore does not require the 
same breadth ot coverage as input and process. A reader is advised to sivim this section 
of the publication until after he has had an opportunity to become involved in the 
simulated, policy-making experience of Chapter 8, unless he luis a particular interest in 
the scope ot the MISOE sample data systems. This chapter does provide a statement of 
the range ot information available to interactively support policy formulation and is 
therefore a useful reference. ., . 

Input Batteries Because of tlie wide range of ages included in the MlSC)E-Sl)S(l ) 
_ and ST)S( 2 ) s amples .and be cause t he a d ult ^educ atkm programs diffe t:-itt~dur;vtia44-^^nd— 
content 6\)m secondary and postsecondary community college -level programs, two 
MISOE mput batteries were assembkd, MISOE Input Battery 1 is to be administered 
to SDSjVl) and SDS(2) students 'at the secondary and postsecondary community 
. college level. Input Battery 11 is to be administered to SDS(l) students at the adult 
and p^tsecondary, noncommunity college level. The individual 'instruments that 
comprise the batteries are described in a later section. * ' 

Several complex tactors were involved in the selection of any given commercial 
I instrument for inclusion in either of the MISOE test batteries. One of the major 
V concerns was that each battery include a comprehensive sample ot those measurable 
\tudent cliaracteristics or behaviors which, on the b^isis of prior research findings or 
our current hypotheses, appeared igiost likely to be related to product and/or impact 
data. Tims, each instrument included in either of the MISOE input test batteries was 
evaluated in terms of its likely value as a predictor of student outcome or behavior. 

A seconjjl related consideration involved in the selection of input instruments was 
that each of the input batteries include a comprehensive measure of diverse student 
behaviors and characteristics. Thus, it was decided that each of the input batteries 
'should 'include cognitive, and noncognitive measures, verbal and nonverbal measures, 
measures of abihty, aciiievement, personaHty, values and attitudes, background 
intormation, including JactorS such as socio-economic status, educationaL and 
\ occupational aspirations, relationships with family and peers, etc. 

A third consideration for every instrument included jn the MISOE input test 
batteries vrjiZ the psychometric properties of the instrument, particularly reliability 
and validity. Only those instruments which we adjudged to be psycliometrically 
sound on tlie basis ot ^information provided in the test manuals and the independent 
reviewers in O. K. Buros' Mental Measurement Yearbooks were included in the 
batteries. 

A tourtfi consideration was whether a given instrum(flit conformed to the specific : 
needs of the MISOE research paradigm. For example, we had originally intended to 
include one of the commercially available interest inventories in one or both of our 
input batteries. One ot oUr requirements for an interest inventory, in addition to the 
previously stated considerations^ was that it be equally directed tcJward tlie interests 
of occupational education and nonoccupational education students. After 
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car^irtty~Teviewmg"'e^^ "well~icn(5wn~ c c^nimerctatt^rirvtnlublc uivcuLbnesirhalr 

met all of our other requirements, it was decided that none of them conformed to this 
specific need. We instead constructed out own' OccupatuMial Aspirations Inventory 
and included it as an item. in our Pupil Inventories. (The Pupil Inventories will be 
discNUSsed in detail at-a later point in this chapter.) .The Pupil Inventories themselves, 
were constructed in-house because of oui^pecific requirements. The rationale for our 
selection of the instruments or commeraally available parts of these instruments 
included in Input Batteries I and H, respectively, is detailed in the following section 
of this chapter. - ^ ' 

A fifth consideration, in addition to those already mentioned, involved the amount 
of time required to administer a given instrument. In order to keep total battery 
administration fime to a minimum, all other things being equal,' the least 
time-consuming instrument was chosen. Testing time tor Input Battery I is five, 
ontrhtr lf school da wr w hile t^?5HFtg-^m^iW>I nput Battery II is ^ five honr s . ^ - 



The rationale behind selection of commercial instruments included in Input 
Battery I is as follows: 
I. The Cognitive Measures ' 1 

As previously mentioned, MISOE is concerned with obtaining a wifle range of 
cognitive measures in Input Battery I. | 
A. The Iowa Tests of Educational Development (ITED) I _J 

One of our majc)r requirements for an achievement battery was that it 
could be used as a measurement of general educational development in a 
pretest, post^est type design. The measure of general educational develop- 
ment is to be administered as part of Input Battery I to SDS(l) and SDS(2) 
students at the very beginning of their enrollment in an occupational or 
nonoccupational education program. These same students are to be retested 
on this same measure of general educational development at the end of their 
respective -programs. Comparisons can then be made between the change 
scores of .various s^tudent groups, for example, occupational vs. nonoccupa^- 
tional education students, on the measure of general educational develop- 
ment. One of our major considerations in selection tor a G.E.D. measure was 
that the change score on this measure reflect pnm-irily cunlculuni effects 
given similar student types. However, since the instrument used to assess 
general educational development is to be administered on a statewide basis, it 
was essential that the instrument which was selected cover a wider range of 
knowledge than that which would be likely to be encompassed by any given 
curriculum. After reviewitig each of the major commercially^ available 
achievement batteries, we narrowed the field down to the two instruments 
" * which appeared to best meet the majority of our requirements. These were: 

1 . The Stanford Achievement Tests High School Battery, and 

2. the Iowa Tests of Educational Development, High School Battery ^ 
On the basis of the fact that the Iowa had been used extensively for many 

years, whereas, the Stanford battery was relatively new, and because pre 
Stanford Achievement Tests are keyed to grade norms, we decided to select 
the Iowa Tests of Educational Development as our achievement battery. 

In addition, the ITED yields a composite score derived from the Reading 



"Tntah Language Arts "Total and MatlieniaUc'scores-^which-^us suspected to — 
correlate hi-glily with a traditional IQ measure. MISOE wanted to include an 
IQ measure in Input Battery.! as it w'as k*lt .that the IQ score offers a 
powerful predictive tool. The MISOE staff is aware of the many legitimate 
criticisms ot the IQ when used as a sole measure of aptitude; however, it was 
tek that these criticisms were not as applicable to a test battery which also 
use<l the Cultute Fair Intelligence Test as a measure of general ability. ^ ^ 

The DifferJntial Aptitude.Test (DAT) \ 

Our primary criteria for multi-aptitude battery was that tlve aptitudes 
measured ilot be highly correlated with measures yielded by the Iowa Tests of 
Educational Development (i.e., that it contribute a unique valid variance) and 
that it provide measures of aptitudes which were most likely to be related to 
product or impact data (i.e., its predictive valuS.) We narrowed our choices 

do w n-4;tv4;lie^ tv vo In s trumen ts whi ch appeared -tB-beiy t m ee t our - critoriar Ae^ 

being: 1) The General Aptitude t5st Battery (GATB), and 2) The Differential 
Aptitude Tests (DA^). A careful study of these instruments revealed that the 
DAT would be preferable to the GATB in terms of the unique valid- variance 
pr()vided it used in conjunction with the ITEU. Based upon this finding, as 
well as a hunch that the DAT would be more appropriate for administration 
to the diverse MKSOE sample, if was selected as the multi-aptitucie battery 
instrument. * ' . 

Aher examining the DAT, it was decided to include only selected scales in 
Input Battery I tor two reasons; Firstly, some jofdie aptitudes measured by 
the DAT appeared to be very similar to scales included in the ITED. Indeed, 
the combined Verbal Reasoning and Numerical Ability score of the DAT was 
h)i^nd to correlate highly (.8()'s) with the composite score of Form X-35 of 
the ITED. Secondly, in order to keep total test admhiistration time to a 
mininmm, while still including a wide range of measures, it was necessary to 
be very selective. 

Thus, the first two scales of the DAT which were eliminated were Verbal 
Reasoning and Numerical Ability* The DAT Language l|sage Scales were also 
\tiUininated from Input Battery I because of their similarity to related ITIED 
Scales. It was also decided lhat the Abstract Reasoning Scale need not be 
included because it would not add mjiich unique vahd variance above* that 
provided by the DAT Space Relations score (r=.63} and the ^Iturc Fair IQ 
score. ^ 

It should be noted that we decided to truncate the DAT rather than the 
ITEp for several reasoirb Firstly, the DAT is constructed so that separate 
scales can be fairly easily administered; this it not trUe of^the single booklet 
ITED.'Secondly, MISOE uses the ITED*in a pretest posJitest* design and this 
argued for keeping the instruments intact in order ro obtain the maximum 
number of change scores. 

The Culture Fair Intelligence Test - Scale 2 " . * , 

The decision to include the Culture Fair Intelligence Test in the input 
batteries was based on several factors. Firstly, smce.the input batteries^ere 
to be administered to a statewide sample of Massachusetts students of varied 
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"cultural~aliJ^ocioeconomicTia^grounHnrw nle-asunr^ 
which is rolativelv uiisubiect to cultural and socioeconomic biases as is ■ 
claimed in the Culture Fair Manual could be a valuable addition to the 
battery. Secondly, it was felt that a Culture Fair (i.e., language freey test 
might be a better predictor of the outcome behaviors of th(< less verbally 
oriented students than ability or achievement measures which are highly 
dependent upon command of the-English language. Inasmuch as the primarf ' 
focus of the MISOE sample is the occupational education student, and since 
it can be hypothesized that many of the students who choose the 
occupational education curriculum are less verbally oriented than students 
who choose the traditional academic curriculum, it was telt that a 
nonlanguage ability test might be a more effectivq predictive tool for this 
sample of studenfs. t \- . 

~~7lftH^~\vF"1ra^~lnadtrrta^Tfe^^^ 
necessary t<5 decide which of the two higher level_scales to use and for whom. 
According to the manual. Scale 2 is designed, foT children 8-14 years old and 
for unsettled (non-college) adults. Scale 3 is designed to discriminate among 
higher ranges of intelligence from high school age through adulthood. In 
order to maximize analysis flexibihty ^nd because of ^the. logistics of the 
testing process it was preferred to use one scale for students at all levels m our 
sample. After carefully examining Scale 3 the staff decided that it would 
probably prove to be too difficult for the majority of our sample; Scale 2, on 
" the other hand, seemed to present the appropriate level of difficulty for the 
majority of our sample, but ran the risk of "topping out" yith the four-year 
cojWe bound students and/or the community college students, /or whom we 
flfi?r7 less apprehensive than the bright four-year college bound students 
because we did not expect that the community college students would be 
significantly different than the majority of the secondary level studeiUs 
Consequently, Scale 2 was administered to several members of tlie MlSOb 
staff who obtained high, but not perfect scores. It was decided to u.se Scale 2 
for all students in the .sample. i ^ 

II. The Noncognitive Measures - ' . , i • i 

The noiw'ognitive measures included in Input Battery I and the raticmalc 
behind tjieir selection are as follows: 

•A. The Junior-Senior High School Personality Questionnaire 

In the area of personality measurement the choices were narrowed to tlie 
three follovving instruments which appeared most consistent with MISOE 
requirements: I) The California Personality Inventory (CPI)j 2) The 16 
Personality Factor* Tesf (16PF); 3) The High School Personality Question- 
naire (HSPQ). essentially a high, school level form of the 16 PF The CPI was 
highfy praised reviewers in Euros (1965) for the empirical method by 
which it was developed. The 16 PF and HSPQ did not appear t6 be as 
psychometrically sound as the .CPI, but offered other a^lvantages. Firstly, it 
was felt that the language used in the CPI might be too sophisticated for some 
of the students in ouf sample.- Secondly, the CPI would contribute least m 
teems of unique valid variance to the battery. Therefore, it was decided to 
eliminate the CPI from consideration, 
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^ ^ C:)Tre<^~agatiirbt*CtU tesnug"jrttuati7)i ' 

to maximize analysis flexibility, it was lioped MISOE could use only one 
personality measure tor students at all levels in our sample, it was felt that 
some ot the language in 16 PF might be a problem for certain students. The » 
language employed in the HSPQ clid not present thiij problem. After caretiil f 
examination of the HSPQ questions it was decided that they would be 
appropriate tor students at all levels afid therefore it was decided to use the 
HSPQ as personality measure, 

B, The Survey ot Personal Values and the Survey of Interpersonal Values 

The decision to include the two Values Surveys-in the input battery was 
based primarily upon a judgement that the values purportedly measured by 
these Surveys (e.g,, leadiership, goal orientation,, practical mindedness) might 
prove to be ot jsigniticant value. The criterioa^alidity data provided in the 
~ - fiurvey inuimaljy alsfr- prcscntcd interesting research possibilities V The Vafucs 
Surveys also met all of our other criteria. ' - 

C. The Survey of Study Habits and Altitudes (SSHA) 

The SSHA purpontedly measures study habits, motivation for studying and ; 
certain attitudes towards ^scholastic activities which are iihportknt in the 
cUissroom, The decision to include this instrument in Input Battery I was 
based upon the assumption that the' attitudes measured mighfr prove to be 
significantly related to, scholastic achievement and that this instrument might 
therefore contribute to the predictive value of the battery. 

The SSHA is available in two forms, a high school form and a college form, 
Affer reviewing both forms it was decided that the high school form could be 
used for students' at all levels in our sample, whereas the college form 
contained language that migji^t be too sophisticated for some students. We 
therefore decided to use the high school form. 
III. Inhouse Instruments I^eveloped £or Input Battery I 

As previously mentioned, MISOE developed its own instruments in those 
instances in which cbmmercialfy or otherwise available instruments did not meet 
staff specifications, 
^A. The Cover Sheet 

The necessity for tiie Cover Sheet which identifies name, address and 
birthdate was created by the decision to employ a security link system for 
' MISOE data. The main purpose of the Cover Sheet is to enable the link 
agency to as.sign a permanent identification (PID) number to a given person's 
data,*' 

B. The Student Master Identification Form (SMIF) 

The Student Master Identification Form contains information about those 
basic and personal student characteristics which could be used to classify 
students for research purposes. This form is <]ilso used to identify the unique 
program in which a given student is enrolled, and, for occupational education 
students, the student's grade and USO^E code configuration. , y 

*Scc Security Safeguard System later on in this chapter. 
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" cTT^helyfals^duisetr^^ • i i t 

Early on in the developmental sj:age ot the input batteries it liad been 

^ decided than an attempt would be made to assess those contextual variables 
(i.e., variables describing those experiences or conditions in a student's lite 
whk-h are exterior to the current school experience) that appeared most 
likelv to be related to pupil outcome behaviors. Some of the contextual 
variables sought were: peer group intluence; relationship with parents; 
socioeconomic and educational background data, etc. In addition, it was 
hoped that the pupil inventory could contain the following additional 
information that was not obtainable from our other instruments; educational 
aspirations of pupils, peers and parents; pupil occupational aspirations and 
pupil self concept. . 

None of the previously available pupil inventories that were examined 
combmed all ()f the inftbmatum that we sought. We riierefor'C decided to 
' ^ construct our own pup'il^jnventory using questions from previously., available 
quesHonnaires, as well as iter^\s developed inhouse. 

Items from previouslv avaiK^le questionnaries were used whenever possible 
because it was felt that this would increase the reliabihty of our instrument 
and reduce the necessity for conducting large-scale reliabihty studies. The 
pupil inventory was field tested in yariT)us stages of development on 
approximately 500 secondary level students of varying levels ot ability. Some 
of these students were given the inventory in very small groups and interacted 
with the developer on these questions which presented problems. The other 
students were told to comment in the margins whenever they had a probleni 
with a question. All of the questionnaries were carefully examined; the [inal 
copy reflects all necessary changes in content,^ structure or language of the 
questions as revealed by the field-testing process. 

The Rationale Behind Selection of Commercial Instruments included ih InpUt 
Battery II is described below: ^ 

[, The Cognitive Measures ' • . 

A. . The Clukure Fair Intelligence Test » i- • 

The same rationale for selecting this test for Input Battery I applies to its 
. inclusion in Input Battery II. 

B. The Differential Aptitude Tests (Form L) • , ^ 

Two additional scales of the DAT in addition to those included in Iivput 
Battery I were addt/d to Input Battery II. These are: 1 ) Verbal Reasoning, and 
2) Numerical Ability. T>^e scales were added to Input Battery II for the 
following reasons: Firstly, the absence of the ITED in Input Batterv II 
•necessitated the addition to Input Battery I of measures of the very basic 
verbal and numerical skills obtained in Input Battery I from the ITED. 
Secondly, the combined verbal reasoning plus numerical ability scores yielded 
by the DAT provides a measure of general scholastic aptitude or intelligence. 

» laput B;ittery II. is basically a truncated, version of Input Battery I. Therefores the rationale for the 
selection of most of the instruments included in Input Battery II has already been discussed in the* 
previous section. f 
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It was felt tliat this score, like the compdsit^ score yielded by the ITED might 
be a powerful predictor of student outcorne behaviors. 
II. The Noncognitive Measures '* 

B^ecause the total testing time allotted to Input Battery II is much less than 
that allotted to input Battery I, it was decided tharthe nurnbeFof nonc~6gnitivc, 
measures included in Input Battery II b'e quite limited. It was decided that^the 
two Values Surveys included in Input Battery I should represent the noncognitive 
measures in the second Input Battery for two reasons. Firstly, these two 
instruments appeared to be the most appropriate noncognitive measures available 
in Input Battery I tor the adults in our sample. (Whenever possible we wanted to 
use the same i'tistruments in both batteries to maximize analysis flexibility). 
Secondly, it was felt that the variables measured by these Value Surveys had the 
greatest potential predictive value in terms of student outcome behaviors. The 
rationale behind their inclusion in Input Battery I also applies to their intlusion 
in hiput Battery IL - • 

III. Inhouse Instruments Developed for Input Battery T » 
The Cover Sheet, Student Master Identi^f"ication Form and an adult level 
version of the pupil inventory (The Massachusetts Adult Level Pupil Inventory) 
were included in Input Battery ILfor the same reasons that they were include^ in 
Input Battery I. It should be noted that the MALPI was field tested in the same 
manner as the MPI, with a sample of approximately 100 adult level students. 

A Look at the l/istruments 

This section will detail the scores or variables generated by each of the instruments 
in'cluded in each of the Input Batteries. The^psjxjjjofnetric properties of the 
commercially available instruments will not be discussed as this information is readily 
available from the test manuals as well as other mdependent sources. It should be noted 
at this point that the decision was tnade to' include only raw scores in the input section 
of the MISOE data erttry systerfi. ^ \, 

Input Battery I ' x.^^ ' W 

A. 'I'he loxva Tests'^oj Hducational Development, Apmi X-5. 

The 13 fTED scores to be entered in the in^utjection of the MISOE 'd^ta 
system for all stud^ents, except adults and noncommunity college, post- 
secondary students are: 

1. Reading Comprehension Score 

2. Vocabulary Score 

3. Reading Total Score (derived from scores 1 and 2} 

4. Language Usage Score • 

5. Spelling Score . 

6. Language Arts Total Score (derived from scores 4 and 5) 

7. Mathematics Score 

8. Composite Score (deriveS from scores 3, 6 and 7) 

9. Social Studies Background Score • ' ' 
M). Social Studies Total Score (derive!^ from scores 1 and 9) 

11. Science Background Score * 
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12. Science Total Score (derived from scores 1 and 11) 

13. Use of Sources Score 

B. The Differential Aptitude Tests, Form L \ 
The 3 DAT scores inckided in I npuiir Battery I are: ^ 

1. Mechanical Reasoning Score , 

2. Spatial Relations Score 

3. clerical Speed and Accuracy ^ 

C. The Culture Fair Intelligence Test, Scale 2, Form A . 
The 5 scores yielded by this test are: 

1. Series Score 

2. ClassiHcation Score 

3. Matrices Score 

4. Conditions (Topology) Score 

5. Total Score (to be converted into IQ score) 

D. The Junior-Senior High School Personality Quest ionnaire, Form A 

The popular terms for the 14 primary scores to be included in the input data 
system for Input Battery I students are: 
^ 1. Factor A Score (Reserved vs. Warmhearted) 
" 2. Factor B Score (Dull vs. Bright) ' " 

NL^actor C Spore (Affected by feelings vs. Emotionally stable) 

4. Factor D Score (Undemonstrative vs. Excitable) 

5. Factor E Score (Obedient vs. Assertive) . 

6. Factor F Score (Sober vs. Enthusiastic) ' ' 

7. Factor G Score (Disreggxds rules vs. Conscientious) 

8. Factor H Score (Shy vs. Adventurous) 

• 9. Factor I Score (Tough-minded Vs. Tender-minded) 

10. Factor J Score (Zestful vs. Circumspect Individualism) 

11. Factor O Score (Self-sCssured vs. Apprehensive) 

12. Factor Qj Score (Socially group dependent vs. Self sufficient) 

13. Factor Q3 Score (Uncontrplled vs. -Controlled) 

14. Factor Q4 Score (Relaxed jvs. Tense) 

E. The Survey of Interpersonal Vahijes 

The 6 values scores" yielded by this instrument and their defiriitions as offered 
in the manual are: 

1. Value for Support Score: Being treated with understanding, receiving 
encouragement from other people, being treated with kindness and 
consideration. ^ 

2,.y^\^e, (or Con fpn^^ Score: Doing what is s ocia lly c orrect, following 
regulations closely, doing what is accepted and proper, being a con- 
formist./ 

3-* Value for Recoj^nition Scor'e: Being 4ooked "up to and admired, being 
considered important, attracting favorable notide,* achieving recognition. 
4. Value for Indepetulence Score: Having the righx to do whatever one wants 
to do^ being free to make one's own decisiotis, being able to do things in 
' >i. one's own way • 
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5. Value for Benevolence Score: Doing things for other people, sliAring with 
others, helping the unfortunate, being generous. 

6. Value for Leadersliip Score: Being in cliarge of other people, having 
authority over others, being in a position of leadership or power. 

F. l1ie Survey of Personal Willies: 

The 6 values scores art: ' . 

L Practical Mindeoness 

2. Achievement ^ * . .. 

3- Variety 

4. Decisiveness ^ 

5. Orderliness ' 

6. Goal Orientation • . ' 

G. Tlie Survey of Stmly Habits and Attitudes, I-orni H 
The 7 scores yielded bWhis instrument are: 

L Delay Avoidance Score 

2. Work Methods Score 

3. Study Habits Score • ^ 

4v Teacher Approval Score . • f 
5. Educational Acceptance Score 
^ 6. Study Attitudes Score 

7. Study Orientation Score * 

H. Tlie Massachusetts Pupil Inventory (MPl) 

Below are listed suggested Generated Variables measured by the MPI-'Ttiiy^ the 
corresponding MPI items. Next to each item, is listed the variable name. Tms-ts 
merely a suggested list, and more informafion on item combining is discussed in 
the final section of this chapter. 

Suggested Generated Variables from the MPl MPI Items 

1. General Student Background Information 1,2,3,6 

2. Student Educational Background Information 11,12,13,14,15,16 

3. Financial Status of Student 4,5 

4. Foreign Language in Home 6,30 

5. Educational Aspirations of Student, Mother, Father, peers. 17,41,62,63 

6. Independence of Student 4,19 

7. Socioeconomic Background ^ H 20-29 

8. Educational Example of Older Siblings, Parents 33,35,51 

9. Peer Group Factors « 36,37,38,39 
10. Self-concept 40 

Social A ct i vi tie s-""— ^ ~ — — — " -— 42743;44- — ^— 

12. Family Financial Matters * 53,54 

13. Relationship v/ith each Parent 55,56^,57,58^5,9,60,61 

14. Parental Interest in School Work 64,65 . 

15. Control of Environment . 67,68,75 j 

Since Input Battery II is a truncation of Input Battery I, it is unnecessary to include a 
list of the subscores. It should be noted that there^are two subscales of the DAT added, 
Verbal Reasoning and Numerical Ability. The MALPI does contain some differences 
from the MPI, but essentially the two instruments obtain the same information. 
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Pw( Cii.< Process information is to be collected^ in ten liigli'cnrollment occupational 
education programs and to include only yariables-tliat are common across all prografns. 
It was felt that this design offered tlie advantage of enabling- comparisons of the effects 
of a given process variable in different, programs, and thus contributes, to analysis 
flexibilityV Future generations of MISOE development can deal with specifying process 
variables within particular programs* 

One additional -constrainT upon the choice of process mix variables was the tact that 
the MISOE research design specified product data was to be collected only once at the 
end of a given cohort's program. Since c^ne of MISOE's stated objectiv,es was to be able 
to establish the ability of a given process variable or of the individual variables which 
constitute a process mix to predict achievement as measured by product data, it 
followed that the process variables which we- chose to investigate should be those 
•variables which could be examined on a time series basis over tlie length of a given 
cohort's program, or those process variables that remain relativd'y stable over 
time-. -Therefore, we eliminated from consideration all process variables which 
were unique to a given time period within a cohort's program (e.g., the 
extent of teacher-pupil interactimi in ii given clas§), and concentrated instead . 
of those variables which could be repeatedly measured over the length of the program 
(e.g., X leachor age). ( , 

The process variables which vyere finally selected fell, into one oftwo following 
categories: non-construct-type process variables and construct-type process variables^ The 
non-construct-type process variables were defined as 'those unidimensional process 
variables which are relatively easily measured or assessed (e.g., teacher age, number of 
years and type of previous work experience, etc.) The construct-type process variables 
were defined as those multidimensional conceptual process variables which because of 
their complexity are relatively difficult to quantify or asses >.g., teacher morale). It was 
our belief that these complex, multidimensional construct-type process variables offered 
the most promise in terms of tlieir ability to predict, the criterion measure. 
M .4 Review of the' tliree ,MlSOli Process Batteries- Thtee proceiis batteries were 
developed for. the purpose of collecting process information. These batteries are: The 
Teacher Process Battery, The Administrator Process Battery and The Student Pp:u;ess 
Battery. Each battery consists of a grouping of self-report questionnaries or inyomorids. 
Other types of measures had been' considered for the collection of process dat/but haJ 
ultimately been rejected for first generation MISOE. 

A. The Teacher Process Battery 

I. The Massachusetts Occupational Education Teacher Survey (MOETS) , 

The MOETS represents a combined version of two earlier instruments 

developed by MISOE Staff: Thie Massachusetts Teacher Inventory and the 

Occupational Education Survey. The major process variables included in the 
MOETS are: , 

a) Teacher Background: This category of process variables includes informa- 
tion concerning educational attaimnent, previous work experience, degree 
of inbreeding (a construct type variable which assesses the extent\to which 
a"^en teacher is a product of the locality in which he/she teaches.) 
^^b). Cerent Professional and Extraprofessional Work Activities: In<pluded in 
thil group of variables is niforifiation concerning teacher load (i.e., amount 
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and type of current teaching activities) * a-nd. extent of rhoonlightiiig 
activities (i.e., amount oi:' time spent working on other jobs concurrently 
with teaching). 

c) Teacher Activities Directed Towards Keeping Abreast of Recent Develop-' 
ments'in His/Her Occupational Area Specialty Subject! This construct-type 
process variable attempts to assess the extent to which and the means by 
which occupational education teachers t^ep up with the recent knowledge 
and practices that develop in their trade area. The hypothesis is that the 
extent to which occupational education teachers keep up with their trade 
will be* significantly related to pupil achievement (i.e.," teachers who keep 
up with their trad'e will be significantly more effective as measured by p,upil 
performance 6n impact objectives). A committee of occupational education 
teachers were consulted in order to determine the range of activities in 
which teachers engage in order to keep up with new developments in their 
trade areas. The questions w<*re developed using this information. 

2. The Teacher Program Questionnaire (TPQ) ' 

The TPQ is a semantic differential attitude scale developed by Dr. Ralph C. 
Wenrich of the School of Education at the University of Michigan. Originally, 
the scale was used to assess attitudes toward occupational education. We. ^are 
using the scale to assess, in this case, the positiveness of a given teacher's 
attitude toward the particular occupational education program that is his/her 
teaching specialty area, as measured by a single score representing an average of 
his/her response to each of the twenty scaled items. 

3. Th^Im^ge of Vocational Education Questionnaire (IVE) 

The IVE is a Likert scale attitude cjuestionnaire, also developed by Dr. 
Wenrich, to assess an individual's attitude toward vocational education. We will - 
use a single average score to represent the positiveness of a given teacher*s' 
attitude toward occupational education-in general. 

4. The Purdue Teacher Opinionnaire (ETO) 

The PTO is a commercially available Likert-type attitude questionnaire 
which is designed to provide a measure of teacher morale. The PTO met 
MISOE standards in terms of being psychometrically sound and was included 
in the Process Battery because it was hypothesized that teacher morale might 
be found to be^significantly related to pupil achievement. 

5. IQ 2is Measured by the Verbal Reasoning Scale -of Form L of the Differential 
^-T\ft4tude Tests 

MISOE staff examined several commercially available short-version IQ tests • 
in our search for an appropriate instrument to include in the Teacher and 
Administrator process batteries including, the Cahfornia Short Form Tests of 
Mental Maturity, the Otis-Lennon Tests of Mental Ability, the Otis Quick 
Scoring IQ Test. MISOE was particularly interested in obtaining a measure of 
verbal intelligence. Coleman (1966) had used a measure of verbal faJ'ity of 
teachers in his 1966 study and had found some relationships between this and 
student achievement. We hypothesized, that a measure of^ teacher verbal 
t^asoning might be even more positively related to pupil achievement. 

The Verbal Reasoning Scale of the Differential Aptitude Tests is aimed at 




41 



the evaluation^ of an ability to abstract or generalize and to think construc- 
tively, rather than at simple fluency or vocabulary recognition. It appeared to 
be the type of measure that the staff had been looking for. The only 
reservations were: firstly, wt^uld the test provide adequate discrimination given 
our sample* of teachers and administrators, (i.e., would it top out?) and, 
secondly, would the teachers and administrators resent taking a test which had 
been administered to part of our student sample? 

the Differential Aptitude Tests ' ai*e^ according to the Sixth Mental 
Measurement Yearbook (Euros, l965), appropriate for grades 8-13 and adults. 
Fur;t'hermore, s:ever^l studie§ ar^ reported in the DAT Manual i,an» the 
appropriateness of the DAT for administration to college freshmen at^veral 
different types of schools. In addition, we, examined the content of the, Verbal 
Reasoning Scale and decided tliat it probably would be appropriate for'dtir 
sample of teachers and administrators. This decision was also based upon the 
fact that the Verbal Reasoning Scale correlates quite highly with other 
measures of verbal IQ, as reported in the test manual, and it has been sMown 
that Verbal iQ scotes are fairly stable owei time. Our second concern that 
teachers and administrators might resent being -tested on an instrument given 
to the student sample was mitigated by the f^t ttat there would be a 
considerable time lag between the student and teacher administrations. 
The Planning Activities Sheet for Teachers and Administrators (PASTA). 

One of the construct-type process variables which we decided to investigate 
in ftrst generation MISOE was termed "Planfulness." Travers states in An 
Introduction to Educational Research (1969, p. 42) that "the emerging 
concept of the curriculum held by research workers and others is that it 
consists of all the planned conditions and events to which the pupil is exposed 
for the purpose of promoting learning It is the planning for^, those 
conditions and events that we decided to investigate with the Planfulness 
process variable. 

The decision to investigate the planfulness process variable was based upon • 
the hypothesis that the amount of planning and/or the type of planning 
activity engaged in by teachers might prove to be significantly related to 
student outcome behaviors (i.e., achievement as measured by product data). 
There is a definite dearth of previous research in thi$ area as was discovered 
when we conducted a search of the literature for studies relating the benefits 
of educational planning to stlident achievement. 

Two interactive dimensions' of teacher planfulness to be examined in ^he 
process research design are: * . * 

1) The Planning Mode: How many hours df pl^inful activity occurred under 
each of the following planning modesj^ 

a) By the teacher planning alone? 

b) By the teacher planning with others at an administratively initiated 
meeting (initiated at the department head level or above). 

c) By the teacher planning with others at a nonadministratively initiated 
meeting (initiated below the department head level). 
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2) The number of Planful Hours Expended in Each of Nine Areas of ■■ 
E4ucational Attivity ' * 

The educational planning areas selected for inclusion in this instru- 
ment were those major planning areas which we hypothesized would be 
. .. ■ " most likely to be related to pupil achievmient. A committee of 
occupational faculty met for one month on a weekly basis with a MISOE 
staff member to help determine which educational planning activities 
should be included in the instrument. It should be noted that the PASTA 
was developed for administration to both teachers and administrators. 
Thus, the educational planning activities chosen were, in addition^^those 
that are performed by either or both of these groups. The planning 
activity variables measured by the PASTA are: 

1. # Hours/week planning instructional activities. 

2. # Hours/week planning which occupational capabilities are to be 
attained by students. 

3. # Hours/week planning student evaluation. < 

4. # Hours/week planning the sequencing and/or coordination of 
* learning tasks. 

5. # Hours/week planning budgetary' matters. 

6. ^ Hours/week, planning for instructional materials to be used by 
students. 

7. # Hours/week planning student disciplinary procedures. 

8. # Hours/week planning'^taff policies. . , 

9. # Hours/week planning scheduling* 

The unit of measure employed in tSe PASTA is the self-reported 
number of pla^ining hours spent by a given teacher or adrninistrator on 
"each of the nine areas of .educational activity by each of the three 
planning modes. The total number of planning hours by each of the 
three modes will be investigated as a process variable as\will the total 
^ number- of planning hours expended on each of the nine\educational 
activities. The overall number of planning hours is a thind process 
variable value yielded by this instrument. \ 
B. The Administrator Process Battery / 

The Administrator Process Battery is essentially a truncated version of the 
Teacher Process Battery developed for administrators above the Department Head 
level. (Department Heads are considered as teachers rather than administrators, 
with the exception of the Planfulness instrument previously discussed). The 
instrument ihcluded in the Administrator Process Battery are: 

1. The Massachusetts Administrator Inventory (MAl) 

This instrument is a truncated version- of the MOETS and includes 
informatic/ti on educational arid occupational background, as well as the 
inbreeding donstruct-type process variable discussed earlier in connection with 
the MOETS. The remainder of the Administrator Battery contains instruments 
used in the Teacher Process Battery. ^ < 

2. The Image of Vocational Education Questionnaire (IVE) 

3. IQ As Measured by the Verbal Reasoning Scale of Form L of the DAT 
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4. The Planning Activities Sheet for Teachers and Administrators (PASTA). ^ 
C. The Student Prj<:)cesii Battery 

The Student Process' Battery consists of two instruments which attempt to 
assess student attitudes. 

1! The Student Program Questionnaire (SPQ) 

This instrument is identical to the semiintic differential type Teacher 
Program Questionnaire employed in the Teacher Process Battery except that it 
attempts to "assess the positiveness of a given student's cfttitude toward the 
-particular educational progress in which a student is enrolled. 

2. The School Sentiment Index (SSI) ' ^ ' ' 

The School Sentiment Index was developed as a criterion referenced 
measure by the Instructional Objectives Exchitnge of the University of 
California at Los Angeles. Tlie SSI is a Likert-type attitude scale containing 83 

•» statement^swhich pertain,to five aspects of student attitude toward school. The 
five sub scale scores .yielded by the SSI are described' as follows: 

a) Attitude Toward Teachers - Le., one's subjective feeHngs about teacher 
behavior with respect to mode of instruction, authority and control, and 
the interpersonal relationship of teacher to pupils. 

b) Attitude ' Toward Learning i.e., one's- attitude toward the learning 
' experience, independeiit. of attitude toward school, teachers and subjects, 

as refl,ected in intellectual curiosity, willingness to study, voluntarism, 
interst in problem solving, etc.^ 

c) Attitude Toward School Structure and Climate - i.e., one'.s attitude toward 
his school as a social center, ^a rule-making and rule-enforcing entity, and an 
extracurricular opportunity system. 

d) Attitude Toward Peers — i;e., one's feehngs regarding the structure and 
climate of relationships within the peer group,* rather than toward 
particular individuals witliin that group. ' 

e) Attitudes Toward School in General - i.e., one's general orientation toward 
schooling, independent of a particular school. In addition, a single total 

, score can be obtained yielding a global estimate of attitude toward school. 
We came across the SSI in our search for an instrument to assess*student 
attitude toward §chooL We were impressed with its comprehensiveness in terms 
of assessing attitude toward many aspects of the school situation. Our only^ 
reservation was that, because of the criterion-referenced nature of the 
instrument, there was no description in the manual of the psychometric 
prop,erties of the instrument. However, it *was decided that since this 
uiformation was not available we. could use our own future clata to obtain 
reliability and validity estimates for this instrument. 
Product information has been previously described and vvill only be briefly 
overviewed here. It includes; 

1. Number of TERMOBS completed per student, as moderated by quality scores, 

2. A measure of General Educational Development (ITED). 

3. Completor/Noncompletor. . 

All product measures are developed on SDS(2) students, with SDS(l) secondary 
students and postsecondary, community college students yielding both completor/ 
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•noncompletor and general educational development data. SDS(l) adults and 
noncommunity college, post secondary students are limited by product descriptioivto 
completion or noncompletion. * » . 

hnpacL The design of tlie^-MISOE sample data systems is probably unique, and 
somewhat pioneering, in explicitly distinguishing the short range, outcomes of 
education from longer range impacts of product upon society. There is, of course, the 
direct impact on the former student as reflected in his ejnployability, job satisfaction, 
and ability to enjoy life and citizenship. Beyond that and, indeed, inseparable from it, 
lies the impact on society of having the right numbers of persons available with the 
right skills needed in the labor force, citizens earning steady incomes, supporting their 
families at comfortable levels, returning economic values to the state in terms of 
productivity; payment of taxes, consumer demand and participation in the social and 
cultural fabric of America. 

These and other dimensions are* not readily measured with any available 
instruments, although various dimensions .have been subjected to measurement by 
military and industrial establishments. Therefore, it vvas necessary to create our own 
instruments to ensure coverage of impact dimensions not usually -tapped, but needed 
to ensure a relevance and connectability of impact to the rest of the MISOE design, 
with all its variety of former students and with the expectation of studying impact 
one year, five years and ten years following the end of the program. Impact is to be 
studied for both completors and dropouts, and this replication over time^xtends the 
longitudinal design of the MISOE sample data system, permitting the capability of 
analyzing career development and the effects of experience on the individual and 
Siociety. , 

Two instruments are used to obtain impact data. The first, in several forms, is an 
extensive inventory completed by the former student. One group of questions 
concerns the respondent and his life-style; e.g., family status, activities, voting 
behavior, economic behavior, mobiTi't-y and attitudes toward Hfe and work. A second 
group of questions* concern the respondent's working career, employment and 
unemployment history, types of employers and job satisfaction. There are some items 
asking for more detailed information about family, income, goods owned or being 
bought on credit, and net worth. Several items are designed to estimate if the 
respondent was unemployed for.any appreciable length of time, his unique process to 
re-enter the labor market. The impact instrument also develops information about a 
variety of state services, including welfare, the lottery, etc. 

The in-house developed impact instrument, the Massachusetts Educational Inipact 
Instrument (MEII), also develops information about the student's attitude toward 
education and whether nr not he is' continuing his education in some form, and at 
what level. 1 here are also a few questTons about military service experience. Finatly7 
the .MEII asks permission 'of the respondent to contact his or her supervisor on the 
current or most recently held full-tiniejob, and to provide the name and address of 
that supervisor. ^ 

The supervisors^ named by the respondents are then contacted by Way of the 
second impact instrument which was developed by the MISOE staff and is called the 
Massachusetts Job Evaluation Inventory (MJEI). The MJEI is essentially a job rating 
form. This instrument seeks some information about the rater, his opportunity to 
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observe the work of the foriner student and whether the rater has held tfie saine job 
himself. Following a number of items on which the supervisor rates- the tornier 
student in general terms, he is asked to do so in terms of i;iore specific traits- and 
• behaviors. Ratings of the most specific traits and behaviors by supervisors are rated 
against others on the same job and compared to what the supervisor believes the job 
requires. Each of these traits fs ranked in terms of its importance to the job. 

It is in impact space that MlSOE'goes beyond the mere assessment of retained 
learning, and asks how it has been put to use. Because it will require some time before 
sampled cohorts have passed through the system and into what the MiSOE staff calls 
impact space, it is planned to obtain a special cross-sectional sample to permit further 
field testing of the in-house developed instruments, as well as an opportunity to 
^•develop experience with the logistics of implementing a large follovvup study. The 
information resulting from this experience could provide a tentative basis- for a 
descriptive summary of what happened to the students from earlier cohorts. Such 
information will not be connected in the MISOE longitudinal research design, but it 
will be gathered by the sampling design, thus providing a basis for both an assessment 
of impact on a cross-sectional basis, with an ability to make some inferential 
connections because of the relationship of the aggregated impact data to the MISOE 
sampling design. 



Security Safej^nard System 

During this discussion ot the structure 
and content of the MISOE sample data 
systems, it should be appare-nt to the 
thoughtful reader that the information 
. supplied by individuals to the MISOE data 
systems must be handled with great care 
by the MISOE staff. To respect the, rights 
and privacy of individuals asked to pro- 
vide confidential information to MISOE, a 
security safeguard system has been 
designed* Its purpose is to prevent anyone 
from being able to associate information 
about an individual with his name and 
address, while still enabling longitudinal 
rf?ta to be collected and referenced to an 
individuals data record. -The system has 



2. The data files and the name and address 
files will have different fD*s and these 
id's can only be linked by a third file 
containing the two. sets of ID numbers. 

3. The name and address and link files 
will be stored in a separate institution 
from the Department of Educatipn, 
with its own computer capability and 
data files. 

4. All data are arbitrarily coded. 

5. All retrievable information is available only 
in summary form. ^ 

6. Special logistics are used to assign and 
handle identification numbers. 

The seeuri^ safeguard system is an 
improved alternative of the highly 
praised safeguard system developed by 
the American Council on Education, 
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being documented. At this time, we can 
'only share a few of the basic principles of 
this system: 

1. Karnes and addresses needed for impact 
follow-up surveys are kept in a file com- 
pletely separated from the MISOE data 
system file; 



The added costs for such security are 
more than ^offset by the maintenance of 
public confidence in MISOE. A manage- 
ment and information system of the 
scope and importance of 'MISOE simply 
cannot afford any breach ot that con- 
fidence. 



ERIC 



4() . • ^ . 



Cti'iieratt'd I \iridhlcs Ck'n I \irs ' 

MISOEJPPl batteries include a large 
uumlier ot instruments, and these instrn 
menc^ in turn, contain huiny items. In 
many instances, individual items are of 
only limited usefulness. Tlieir basic pur- 
pose is to describe a^variabte in concert 
with other items from an instrument. An 
example of a Gen Var has already been 
offered with the *Massachusetts Pupil In- 
ventory (MPI). h was suggested that 
certain items could be suminarized to 
yield a measure of n variable, i.e., item 
()4, 65 describing *'parental interest in 
sciiool wt)rk.'" .This is what MISOE 
means by a Gen Var. ' 

For many comniercial instruments, 
individual iteni scores will not be in- 
cluded an the student record, only' the 
scale score. For example, from the ITED 
only, one score for Vocabulary will be 
stored in the data files, and this is also 
an example of a Gen Var. . 

Gen Vars can be determined a priori 
in MISOE by simply sununing equally 
weighted items of an inventory or test 
instrument, or by some form of analysis. 
Gen Vars can also be d'eyeloped inter- 
actively by a user from individual items 
.of inventories, by TERMOBS, or by sub- 
scores of commercial tests. The usufu- 



ness of this *optio4i should become ap- 
parent during tJie reading of 0iapter 8. 

( .oncliisic^ii 

This chapter has described the 
MISOE sainple data systems in non- 
technical detail. It has not included any 
information about costs' or expendi- 
tures, a fundamental part of the sainple 
data systems. This. is a purp,i)sefu} oniis- 

^ sion due to the specialized nature of 
MISOE cost systems. 

Chapter 5 describes the MISOE 'cost 
analysis systems in detail, including 
those of the^ sample -data systems. For 
those interested in a full understanding 

. of the MISOE sample data systems, a 
careful reading of Chapter 5 is reconi- - 
mended. For those 'who are skimming 
their way through the four chapters 
which describe the structure of MISOE,- 
the best advice is to continue skimming 
through .^Chapter 5. However, since 
economic analysis is basic to policy 
development at the state level, it is advis- 
able to know the source of cost informa- 
tion. The casual reader might -be in- 
terested in returning to Chapter 5 after 
working through thc^ pcJlicy formulat-fon 
example of Chapter 8. 
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CHAPTERS 

ECONOMICsfef PUBLIC INVESTMENT IN EDUCATION 
ANJD<MIS0E COST ANALYSIS SYSTEMS 



Gerald Downey 



The purpose of this chapter is twotold: 
(1) to ' provide the reader with an 
economist's view of education as a social 
investment. (Part I); and (2) to offer a 
description of the basis for MISOE cost 
systems, (Part II). Part I should be of 
interest to those concerned in leurning 
about some of the eeonomie assump- 




tions and principles in cost benefit 
analysis, while Part II describes the 
source of MISOE economic data. The 
reader who is not overly comniitted to 
MISOE (yet) should skip Part I, and 
quickly skim Part II, such that he at 
least has ; a ''feel" for the source 'of 
SOE cost information* 



PART I: THE ECOr^OMICSOF PUBLIC INVESTMENT IN EDUCATION 



'The improvement in the quality^ of 
human capital through education and . 
training provides a social rate ot return 
tiiirough the increase of future output ot 
the society just afK does iavestment in 
' Ti()filTirmaTr" eaT5iti\j/ -"tiirii-'-ais^-TH -imd-- 
equipment. \<v^rc\\ suggests . that the 
rate of return on investment in human 
capital niay be substantially higher than 
the retiuMi on investments in capital 
goods. Theodore Sehultz (^1961) states 
that investment in education by society 
has allowed western nations to 



grow at a much faster rate ^han with 
hivestinent in nonhuman capital. The 
Denison study (1962) found that since 
1929 improvements in the quality of labor 
and capital (technological advance) have 

- ac c oun tcd^'-fcr-twer-^Ht^4mtf of tt^ 
economic growth in the United States; it 
also suggests that if the growth in 
population is eliminated because it does 

•not significantly raise output, then im- 
provement in the quality of labor has ac- 
counted for over two-thirds of the econohi- 
ic growth in the United States since 1929. 
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Job training occurs in the private sector 
as well as tlie public sector. For example, 
tirnis provide both tornial and intornial 
training in the private st^ct^r at their t)vvn 
expense. The pttbilt ^sectbr also *>^ibsidi7.es 
other forms ot job trainiiig outside the 
noriyal educational process. 

Priwitf (i\j(>i/>. , C.olU'ctivc ^-Chnnls, iT.v 
tcmdlitu's ami Ihiblic lnvc.<t))W)it 

The resources ot our society ap^ 
liiuiced, but at the same time the^jivtmts 
of our society are virt^j5Lal4y''lmli 
Sitice the economic resources that can be 
Used tor education are also limited, the 
problem ot public rcsouri;e allocation 
arises. The economist is interested in the 
public resource alU)cation problem and is 
looking tor the most etticient method ot 
training students to be productive mem- 
bers ot the labor torce. 

in a market society the vast majority ot 
goods and services are met by private 
enterprise* It markets are competitive 
markets, prices retlect the values ot goods 
to consumers and marginal costs to the 
producers ot priyate goods. Food and 
clothing are examples (>t private goods. 
However, there are some goods and 
services tor which the marketplace tunc 
tions improperly theses are collective 
goods. (). Eckstein detines collective 
goods as follows: 

I'lu'sc arc goods and - .services that simply 
* cannot he p^o^^ided through the market. They 

have two related qualitieji. First, they in- 

people rather than on an individual basis. 
,Sccond, they cannot be withheld from indi 
viduals whf) rt-fuse to pay for them, i Eckstein, 

National de tense is an example ot a 
collective good. Each individual member 
of the societYN benefits trom this service. 



There is no way of withholding this 
service fruni those unwilling to pay tor it 
as the seller ot a private service couljJ. 
Thus, the distinction I'^etween a private* 
good and a collecM:ive g^xl can be based 
on an exclusion principle.* It persons can 
be excluded Trcmi benefits of a good or 
service it is considered to be a private 
good ()r service; if exclusion is not pos- 
sible it is considered to be a collective 
good or service. 

In some cases price may not retlect all 
benefits to be derived from* a good be- 
cause it does not take into consideration 
the social benefits ot the good. These 
social benefits are called externalities or 
external economies. Where there are ex- 
ternalities present, price may retlect 
marginal private benefits but riot marginal 
social benefits. Collective goods or public 
goods are extreme examples of this. Since 
external benefits arc not taken into con- 
sideration by the marketplace, the 
"reliance upon the private market to sup- 
ply collective goods results in a less than 
optimal allocation ot resources to their 
production. 

The previous statement suggests that in 
any situation where some costs or benefits 
remain outside of the price-marginal cost 
decision-making process, resource alloca- 
tion becomes inefficient. For this reason, 
where externalities are important, public 
investment in the production of certain 
goods and services .may be: necessary in 
" order to improve resource allocation. " 
Several authors have called attention to 
the importance of externalities in 
— c^ ucatiom For gxample -r ( V Eckste i n lias 
pointed out: * 

Everybody g^^in^* from living in a democracy 
with an educated citizenry. Also, some of 
the economic benefits of . having an ed- 
ucated labor force accrues to employers 
tbifough lower production costs, and to 
customers through lower prices, though it's 
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impossible to dAermine precise amounts 
(Ecksrehi. 1^67). 
B. A. Weisbroci has aHiimented simihirly: 
Persons receiving external benetit^ truni a 
student's education ^may be divided into three 
trioad' grou^s^i^fGttgh the same people may be 
in * more than one: 1 ) Residence-Related' 
Beneficiaries Those who benefit by virtue 
of some relationship between their place of 
residence and that of the subject; (2) Empby- 
ment-Related ^Beneficiaries - Those who 
* benefit by virtue of some employment rela- 
'tionship with the subject; (3) Society iti 
General fWei^brod. 1964). 
Thus', schooling benefits persons other 
tlian the student. His present family as 
well as his future Taniily also benefit. His 
children will benefit from the intormal . 
training t|iey receive in the home. His 
neighborhood and his community will 
also benefit from the social values he 
obtained f^atn receiving schooling. 

If educaticHi provides sociar benefits, 
decisi()n-makers\l^^^^ild ^'^^s into con- 
sideration in the\ allocation of public 
funds to •schooling.^It 'is also true that 
external benefits may difter between 
educational alternatives within and 
among schools. 

Piihlic [iitcrvciitiofi into liducatiori in 
Order to Redress; [mpcrfrctioiK of -the 
i '.OfHpctitive Sy.<tc}n 

Another major source of niarket failure* 
is the presence of serious imperfections in 
the competitive n).echanism. Education is 
one of the areas in which t|ie presence of 
'^marEeT^impef^ 
investment by the private sector. There- 
fore, intervention has become necessary 
by the public sector in order to redress 
the imperfe'ction5^ 'of the .competitive 
system. Intervention has taken the form 
of the* investment of public funds in 
providing educational training. 
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In a competitive niarkt't, workers • 
would purchase training themselves be 
cause tliey ^vould obtain all the benefits*. 
However, in an in>perfoct market workers 
may- hayi^ 'imperfect foresight regarding 
, the* advantages of training and may also 
have a short jinie horizon regarding their 
'Workhig life. Many workers are un- 
informed about possible future employ- 
ment opportunities due to investment in 
training, it may also be true, thac lai-k^of 
access to capital on the part of the 
workers keeps tliem from purchasing the 
necessary training. Imperfections on the 
buyer-side of the labor market (i.e., 
nvonapoly power) may also cause under- 
investment in training by workers. 

Intervention by the public sector is 
therefore necessary in the area of educa- 
tional training. It is necessary 'in order to 
insure that potential social benefits will be 
obtained and that no excessive social cost 
will be incurred by the society. 

Cost lioicfit \tuil\\<i.< cJH(/ Public Iidiica- 
tio>i l)eri,<ions 

• In the private sector of our economy 
the marketplace evaluates goods and 
services. Inefficient firilis that do not 
satisfy the needs of consumers do not 
^survive in the IcMjg run. However, the 
'marketplace is not available in the public 
sector to test the efficiency of public 
goods. Thus,' cost bunefit analysis is used 
> as a substitute for t^* marketplace to test 
'the efficiency of public goods. Since 
education is a public good, cost-benefit 
atTaiy.^r"rnTr' be ust r d -" ta . evalut^irhx^ma-^ 
t^we forms of public invej^tment in -educa- 
tion. ^ 

As an overview of cost-benefit analy.sis,^ 
the cost and benefits, of |ach form of 
public education are estimated.. If the 
marginal social cost exceeds the marginal 
social benefit, investment of public funds 



niav he uiulosirablc. IF tlic iiiargiiuil sociiil 
hciietits exceed the iiuir^inal social cost, 
the alternative can be considered From an 
investment standpoint. It the marginal 
social benefits exceed the marginal social 
cy>st h>r more than one alternative, fhe 
alternatives can be ranked by computing 
the cost benetit ratios or the pay-back 
period. Public Funds should be first 
expended on the aiternative with the 
higiie>T cijst beneUt ratio or the shortest 
pay back period. However, as expenditure 
<il" tunds increase on one activity, its 
nm'rginal bene tits drop, thereby reducing 
tile cost beneHt ratio and allowing Funds 
to be spent on (Uher alternatives. The 
benehts per dollar ot public Funds should 
tie eq liati/ed a t ^t h e n In? 
.Kxompl-ished by expanding the expcrrdi- 
rxTi^W^^H44k"4ttnds'iip tu the point wherc^ 
the ct).st benefit ratios ot all alternatives 
are equal. The procedure is to discount 
the streams ot'beneHts and costs for each 
alternative <it some given rate oF interest. 
The alternative Where discounted bencFits 
exceeded discounted costs by the largest 
aniiijmt would be selected first For the 
investment (A the limited public tunds. 
The aim t^t the decision-maker should be 
to allocate the limited public tunds ayail- 
cd^le for investment in education in the 
innst Cost eih.^ctive maniier possibirr i 

»/j/f //iN in tin Mt\L<iiri'}}!i }}t ()/ ('oy^ <n/c/ 

,M /ff 

Measure men r ot cost presents a prob- 
lem tor'cost beneiit analysis. The cost of 
providing education tails on the individ- 
u.tk tht^ community, and society at large. 
However, some ot these costs are difficult, 
it not impossible, tt) measure in dollar 
terms. . I 'niess all ot tiiese costs can be 
measiiri-d in monetary terms, it is iitipos- 
siblt* to measure the total cost oF educa- 
tion. I'l^ir instance, the cost ot education 



to the individual includes lunch and -pin 
money as well as the earnings he toreg(u*s 
by remaining in school after tjie legal quit 
age this may be a very substantial sum. 
The cost to the ccMumunity includes the 
current cost ot operating the school, the 
cost ot land and buildings, the toregone 
interest that could be eiirned on public 
tunds . tied up in land, building, and 
equipment, and the tax revenues lost it 
these public properties Were privately 
owned. The cost to society at large 
consists ot >i3^)th individual and com- 
munity costs. . ^ 

Measurement of benefits tends to be 
more 'difficult to mea,sure than cost. In 
cost-benefit analysis the major empluisis is 
"ptlicFct^ on measurmg^ n uMfeta r y can i Ti i gs 
"and employment behavior. However, it is 
difficult tO' obtain intormatit^n on enrn- 
ings nnd employment behavior -ot students 
over long periods ot time, juid comparison 
made between students at a point in time 
shortly after graduation may be^ mi*^- 
Jeading. 

It is also true that education provides 
external benefits to society which are 
difficult to"quantify^ such ^is good citizen- 
ship, reduction' of crime and delinquency, 
an educated labor force for ^ employers,, 
a iK|^_liu^_pat.ciLiia-l — tor higliei^ Tates ot 
economic growth for tlie scjciety at large. 
There is also the problem ot including all 
the social benefits as well as quantifying 
these benefits. Even though these social 
benefits are difficult to quantify, an effort 
should be made 'to clcveJop proxies^ or 
indices to place a value on them. How- 
ever, these monetary social benefits are 
not. taken into consider<ii:ioir in cost- 
benefit analysis but are used; in the more 
detailed cost-impact analysis. 

l)i.<cohnt Rii/c.s" iiHc/ lnrcs't}}}r}it Criteria 

^ i^lncc the various investment a I tenia 
tiveji '!nay have different profiles 'of cost 
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and Ivnefits over time, diseounting is used 
ti) reduce these future tloWH to tlieir 
prev^U v.iliie. We vvDuld then „be abh* to 
loi»k at each invt^stinent alternative and 
c(Mnpar<* theni to one another. 'I'he pur 
p()j;r of disei)unting i^ to assign weights to 
these profiles of costs and benefits so that 
considt^ration can be given to risk and 
productivitv of the i^ive.stnients as well as 
the public .and private time preferences. 
(uMieraiiy, more thaUone discount rate is 
selected because market .interest rates may 
vary over^time due to economic condi- 
tion> aiul chani2;es in the discount race bv 
the Fn'deral Reserve' Board. 

hi terms ot nnvestnienr criteria, three 
basic rules have been us'ed tor public 
^HpeiKtrtuiv dectsionlsr the "Tfet preseiir 



value rule, the cost-benefit rule and the 
internal rate of return rule. 

The first two are tlie most comnu^nly 
used, i'he net present value rule WH)uld 
select investment alternatives where the 
present value of^ benefits exceeds the 
present value of costs. 'I'he alternatives 
can be ranked by the highest present value 
first, etc. This technique is normally used 
after tlie students have been in-the labor 
market for a number ot years. Where only 
the benefits for one year are knowi.u the 
number of years the benefits would have 
to continue to make up the present value 
of the extra ctisc could be used as a 
ranking criteria. Chapter 8 .otters an 
example which suggestis the use ()t cost- 



PART 2: PROGRAM COST ACCOUMTiNG FOR MiSOE (CDS & SDS) 



Important groups witliin Anterican 
economy tpdav are highly critjcal of 
public education. This criticism comes 
from legislators, parents, stiidents, 
teachers and otlier interested parties. It is 
also true that at all levels of government, 
educational expenditures constitute a sub 
stantial part of their total expenditure 
budgets this is er.pecially true at the 
local level. However, there are also (Jther 
public services that are in need ot these 
resources, Since the rescnirces i^t the 
public sector are limited, a conflict exists 
in u-rms of how these limited public 

nTsoTTrcr^i--sh4Hdd b^^ allocated. This con- 
flict, as well a.s the criticism of the quality 
of American' educatiim, will focce educa- 

^tors in the future tci provide iinore and 
better education of how they-pxpend the 
liinited resources made avaihd")le to them. 

It should also te pointed out that even 
within education there is a great deal of 
competition for the limited public 
resources available: at the secondary level, 
academic vs. vocafTonal technical educa 



t-ion; and at the postsecondary level, 
junior colleges v.s. four year colleges and 
unvversities. There is also competition 
betwee^i levels. Tluis^ in order t« obtain 
their share of the limited public n^so^rces 
available, each educational alternative 
should be able to demonsti'ate that -it is 
operating in an efficient manner. This 
requires a system ^ of accountability 
through. which educational mam\gers can. 
demonstrate that -they are achieving the 
maximum output possible witii the 
limited resources majfe available to them. 
The purpose of this chapter is to describe 
the C()st accc^unting systc^n for stipulating 
costs in the MISOE data systemj). 

}:xis'tbi{y Co.^t and I[jfcctivc}H\<.< hifornui- 
' tio}i tuid tlie .\ccil< of lidiicatioiiai 
l)cci.<io}hMaiicrs 

/""^^•equentlv managers make decisions on 
the distribution of funds to occupational 
programs with limited information on the 
cost of the programs or the effectiveness 
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of their decisions. There is little evideiice 
that the tull costot a program or its cost 
effectiveness is ilsed for decisionmaking 
purptxses. 

Cost intbrmatio!! in terms of doHars 
spent annually by communities and dis- 
persed by the Federal Government and a 
state is usually available. However, this 
information is very gross in nature afTth 
does not adequately describe the cost of 
education in sucli a way that it would be 
usetiil tor decision-making. For instance, 
at the local level the total cost of individ- 
ual programs and the per pupil cost of 
training for individual -programs is gen- 
erally not available. Only average current 
cost information is available by individual 
t^clitn^lty- or iw ^jome-'Ciitjt^; 'for tTie whole' • • 
scjiool system. However, administrators 
know tlvat substantial diffcr^rnces occur in 
individual program cost within and among 
schools of various types and by level of 
training. The effectiveness of administra- 
tive decisions is determined by the ability 
of program completors to obtain a job (in * 
most cases any job) and by follow-up 
studies which are biased in many cases. 

Interviews with vocational ^dministr^- 
tors at the LEA level indicate that they 
desire informittion on the cost of pro- 
viding training for individual programs 
within their jurisdiction. They also need 
better follow-up information on program 
completors to determine the effectiveness 
of the training provided. (Downey, 1971) 

(!«irrently. funds (resources) are allo- 
cated on the basis of 'proposals local 
educational agencies submit. In many 
ca.ses these propo.sals are of the . **blue 
sky'' variety, iuid administrators have Httle 
data to compare the proposals and for 
making decisions. Thus, it is difficult to 
determine whether a proposal should be 
funded or not. What program managers 
really nf^cd to know is the cost of estab- 
lishing new programs and the cost of 
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adding additional students to an existing 
program that has been established. Pro- 
gram directors also need information of 
the training effectiveness of jjrogranis 
they fund. At the present time mantigers 

' Jiave little, if any idea of how effective 
training is or what happens to the pro- 
gram completors once they enter 'the 
labor market. 

Thus; it can be concluded that at the 
present time managers arov making decisions 
on the allocation and distribution of public 
funds (i.e., resources) to occirpatioiial 
education programs with little idea of the 
cost or the effectiveness of their decisions. 
Tife profit motive of the private sector 
would prevent this situation from existing 

" forgery-- loTi^TO private^ firr^^ 
there was little incentive for public 
agencies such as education to becomcv^ 
more, efficient. However, now pressure 
from interested parties and ^^reduction in 
thei priority list for education makes it 
imperative that education* become -more 
efficient in the allocation of its^limited 
resources. Program^ cost /information'and 
per pupil cost information must be niade 
available to /vocational administrators for 
decision-making purposes. They also 
should have inforiTTation oh the effective- 
ness and impact 'of their^ decisions on 
society. 

It is clear that a major function of the 
Management Information System for Oc- 
cupational Education is to^ improve the 
efficiency of the decision-making process; 
Efficiency is defined as achieving the most- 
with a given amount of resources, or 
achieving a given goal with the ' least 
amount of resources. An efficient manage- 
ment process assumes that all the goals are 
in fact stated and there is a regular process 
of determWng the degree to \yhich these 
objectives aiuL-g^oals are achieved and at 
what cost. It also assumes that there is a 
way of describing the relationship be- 
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tween elements of the educational pro- 
gram and educational oCitcomes which can 
be defined iti terms of dollars Unless 
educational maniigers have access to such 
information on a reg;ular basis, we cannot 
expect thetn to behave in a rational way. 
Therefore, a rational management process 
for "occupational education is dependent 
upon a continuous flow ot information 
which describes the goals and objectives 
of occupatic^ial education, the degree to 
which they are accomplished, and the 
elements which, contribute to the accom- 
plishment of the stated (objectives. All this 
information must' be available in t:erms ot 
cost. 

• ■« 

"^]^t^Ht'u* "of ''l^ 

Report I'onns l-or lixprriditurt*.< 

There are three basic reporting groups 
within the school system - the depart- 
ment head, the school principal, and the 
superintendent of schools. At the depart- 
ifient leveK the basic_ reporting forms arc 
the Fali Occupational Teaching Survey, 
the Fall Report, the End-of-Year Funding 
and Expenditure Report, jmdjJb*? End-of- 
Year Report. 

The Fall Occupational Teaching Survey 
provides information on the staff chan^- * 
terij*ics of occupational department mem- 
bers as well as their teaching assignments. 
Th iSv individual faculty members can be ' 
keyed to specific occupational programs 
in regard to' what group of students they 
are teaching. Their teaching salary and 
administrative salary (if any) can be pro- 
rated to the individual occupational pro- 
gram(s) *that they te^ich. Since peaching 
salaries account for a substantial part of 
^current pr(^gram« cost, this is extremely 
important dntorm&tion in the determina- . 
tivn of the cost of individual occupaticMial 
progran^. ^ •* 

Tlie Fall Report is prepared for each 



individual occupational program within 
the school. It cpntahis information on the 
grade level and type of student enrolled in 
tlie program by USOE code for all grades 
below the final grade and the final grade. 
It also, provides the TERMOBS to be 
completed by the final grade. The ques- 
tion of how long dd^s it take to get a 
prograhi completed ni a particular (jiccupa- 
tional program is also an.swered. Informa- 
tion, on .the instructional area(s) used for ^ 
specific student groups in a particular 
program is also presented. Thus, instruc- 
tional area(s) can be tied tcy^gffcident 
groups and teaching staff inn^rmation. 
This provides important information for 
analysis of pupil/teacher ratios and square 
"i^ci'(>iagl^perTfuife 

tional prognuVis. A table is also completed 
regarding the breakdown of sfudent's time 
ii^^each pr-ogram by USOE code and type- 
of *>tudent. This information will be used 
for the proration of; edi\ational expendi- 
tures between the nonoccupatioiTal and 
oGCupatiorial training areas. Other infor-., 
mation is provided on how the programs 
are funded, type of ]*OTdlcapped student 
enrolled (if any), and the history of this 
particulai^ccupational program. 
^The Enci of Year Report on Funding 
and Expenditurt^s provides data on 
whether or not the program is federally 
funded. However, the -mo.st important 
information contained in this report refers 
to current occupational program expendi- 
tures. Dei^criptions of .selected current 
expenditures are requested by individual 
occupational education program^ This 
information, when combined with end of 
year expenditures reported by the super-- 
intendent of* schools, will be used in 
HOivihg at the cost of trainiiig for individ- 
ual occupational programs. This report 
also collects information on equipment 
expenditure ** incurred by the program 
during the school year by type, of 
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expenditure (new or rtplaccnient)^ and 
USOE codc(s). 

The End of-.Year Ri-port troni tlie Head 
of the Occupational Education Depart-, 
mcnt reports on the .status within the 
dep^rtnievlt by student group, type ot 
student, grade level, and USC4€ code(s):It 
indicates what happened the original^ 
enrollees in the progriCny Hid they Ix*- 
, come dropouts, repeaters, or program 
completors? This report also requests 
inForni^ition on \\ow the various types ot 
students spend his/her thne learning in the 
program by USOE code(s). 

At the school principal's level the basic 
reporting forms are the Fall Principal's 
Report and the Principal\s End-of-Year 
Tlie""T^ilt Frincipal^ Report 



CQst per student. based on an average ApM 
f()r a particular type ot student. 
' At the Superintendent, ot Sdiool level 
the basic reporting tornis are the Fall 
Report and tlie Suppleinent tc^ the Super 
intendent's End-of-Year * Pupil and 
Financial Repc^rt. The Superintendent's 
Fall Report provides expenditure intornia- 
tion v^hich will be used to ca.lculat't* an 
implicit rent on both a school and per 
student basis. It also contains enrollnient" 
and staff information on a system-wide 
basis; • 

The Supplement to the Superintend- 
ent's Ejid-of-Year Pupil and Financial 
Report provides important expenditure 
information for determining program cost 
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provides intormation ^ on individual 
school enrollment in occupational and 
non-occupational programs (by. grade, 
race and sex). This is the basic en- 
roUnient ^data used in proration of 
educational expenditures. The Fall Princi- 
pal\s Report also provides; intormation on 
the use and size of instructional area. For 
ULstance, it provides total instructional, 
areas by type ot rooms and also breaks 
out the rooms and floor space used for 
occupational training, h also indicates 
which rocHns are used tor yccupatioiial 
training, ihe tlt^^r space and student 
capacity ot the rooms, who uses the' 
rooms, and when the rooms are tree' ot 
classes. 

The principal's End>of-Year RoP^*^'^ 
gives the number ot i4idividual school 
^ grifduates by grade level, sex, race, and 
type (>f student (non-occupational and^ 
occupational). It also provides data on 
program completors on a school basis. 
This report i\Lso gives the average daily 
niemberslup (ADM) and average daily 
attendance (ADA) by type of student 
(occupational and non-occupational) 
which can be used to determine program 



vvTthin the individual school. Eacli school 
which offers oqcupational training pro- 
gram(s) ^nast complete this supplemental 
packet which requests school committee 
expenditures in tlic form of school totals 
and for each program area in which 
occupational training programs are 
offered. For most communities that have 
only one ccjmprehcnsive high school, 
completion of these tables present little 
problem because moSf of the data re- 
quested can be found in the Ei\d-of-Year 
Pupil and Financial Report prepared by 
the Superintendent of Scho()ls ot the 
connnunity. However, the information is 
preseittv'd by . program areas and not by 
school totals. School administrators mu.st 
I t1i6rc;fore select out of the End-ot-Year 
,jRi*pcn*t the expenditures that are relative 
to their sfliool(s) which otYer occupa- 
tional training programs. 

/:vf///i^tfi> Curroit i:i\<t At 'Hie /Vo^mn// , 
lA'irl I'orMiSOl'K^DS 

Current cost consists of the 10()()-50()0 
accounts (admini.stration, instruction, 
other school .services, operation and main- 
tenance of ' plant services, and tixed 
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charges). Tlie Supplenieiu to tlie Siipcr- 
inteaJeiit's Encl-oF-Yoar Report reports 
these eiirfeiit costs by scIuhjI total .nul hy 
y^prtT^atJi area(s> in vvliieli occiipatioiuil - 
f training programs are ottVri-cU Where more 
V than (iae occupational program is present 
within a program area, per student charges 
can be di^termineii tor numy c)t the 
educati4)nal expenditures that were 
assigned, to the area. It is also possible to 
classiiy/many ot the expenditures as being 
either occupational or non-occupational. 
Those expenditures tluit cannot be classi 
tied as cithtT oi the above are classi tied as 
''all other'* and" will be prorated to, the 
occupational and nonoccupatic^n^d expen 
diture tvpes based on class time spent iir 
the two training areas. 
, Tlie ex^penditure int'ormation by pro- 
gram areas rep{)rted in the Supplement to 
the Superintendent's End-oF-Year Report 
will be combined with the expenditure 
informaticVn reported by individual 
occupational programs in the End-ot-Year 
Funding and Expenditure Report in order 
to estimate tlie current cost ot.each 
hidividual occupational program. Past 
studies have indicated that teaching 
salaries, supplies and textbooks constitute 
the majcirity ot' current cost in individual 
programs.. (C'ora/zini, and Downey, 

J971). MISOE-CDS -can directly associate 
occupational 'teaching salaries, supplies 
and textbook expenditures, departnieiit 
head salaries, maintenance ot equipment 
expeSiditures, and other special reported' 
current expenditures with individual 
occupatitinal programs. The remaining' 
expenditures would be prorated to the 
individual occupational programs on the 
basilt of proration tornuilae and tech- 
niques. 

For illustrative purposes, several tables 
* have been generated of current . program 
cost in a hypothetical high school. Two 
programs and the aci^demic 
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program of this high school will be pre- 
sented and brietlyr reviewed. In Table 1 
(ProgrcUn (loder^ODOl Automechanics 

C)ccupational Day Prxjgram) the vast 
majority of in,<t)Hi tioihil services expend!- » 
tures can be classified as either, oecupa: 
tional or ncMioccupational expenditures. 
Expenditures classified as **all others" 
were prorated to occupational and non- '* 
occupational expenditure types on a 50% 

5()''/f; basis, based on the mix ot occupa- 
tional and nonoccupational training taken 
bv the stu'Jients. The same technique was 
used for supportive services. The summa- 
tion of the subtotals tor .both instruc- 
tional services and snnnorcive .services 
determines the total current cost of train- 
ing in the program ($142,987) and- this 
total . has been broken out into the 
occupational ($82,082) and nonoccupa- 
tional ($60, 905) portions. Also, the cur 
rcJU '-ost (xf per pupil training is computed 
(in total and by expenditure type) tor 
three, different basis beginning enroll- 
ment, program completers', and average 
daily membership. The assumption is 
made that average daily membership is 
80% of fall enrcjllment in all progranifi. 
The cost per pupil and co.st per student 
hour of iiistruction are also computed tor 
the instructional services and suppc^rcive 
services t*xpenditure areas. The data indi- 
cates that occupational training is more 
expensive than academic training in this 
program and that instructioui^l services 
represent approximately 75% u}^i*,urrent 
cost. Also, w 'en beginning enroUi/nent in 
the program is adjusted tor program 
completors and/or ADM, the- curr-ent co»st 
of per pupil training increases substan- 
tially.^ 

hi Table 2 (Progiam Code ()0()04 
office Education ' regular day program) 
the 'tall other'' colunm of expenditures 
was prorated 33.3% to occupational and 
66.7% to nonoccupational, based on the 
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TABLE 1 

OCCUPATIONAL DAY PROGRAM ^ AUTOMECHANICS 
Program Code (QOOOl); Dept. Code 1703 
Beginning Enrollment =75 Students 
End of Year Completors = 63 Students 
Average Daily Membership = 60 Students 



- ■- - l--- - -r - --, 




.(1) 


• (2) 


(3) 






Types of E 


xpenditures 




Expenditures 


Total 


Occupa- 
tional 


Nonoccupa- 
tional 


All Other 


Instructional Services: 

(2100) Supervision 

(2200) Principal's Otficc 

(2300-01) Professional Salaries-Teaching 

(2300-04). Contracted Semces-TeaChmg 

(2300-05) Supplies-Teaching 
, (2400) Textbooks 

(2500) Library Services 
-) (2600-01) Professional Salaries-- Audio* Visual 
/ (zoUU-Ud) ouppUes-- Audio- Viisual 

(2700) Guidance Servicfcs . 

(2800) Psychol6gical(Se)vices 

(2900-01 ) Professional SalSrics-^ Ed. TV 

(2900-05) Sypplies--Ed.TV 

Other Instructional Expenditures * 


1 3,728 
5,690 

55,388 
7,455 

18,728 
3,500 
3,728 
1,500 

3,000 
1,575 
L500 
750 


1 1,500 

. 38,500 ' 

15,000 
^ 500 


$ 2,228 

16,888 
7,455 
3,728 
3,000 

750 


$ 

5,690 

•3,728 
1,500 

3,000 
1,575 
1,500 


Subtotal 


$107,292 


$55,500 


$34,799 


$16,993 


Proration of All Other Expend, by Time 
Spent in Nonoccupa. & Occupa. Areas ' 




8,497 


8,496* 




^otal Instruc. Services Expend, by Type 
. of Expenditure 


107,292 


^63,997 


43,295 




Supportive Services: 
'(1000) Administration 
. (3000) Other School Services 
(4110) Custodial Services 
(4120) Heating of Building 
(4130) Utility Services 
(4210) Maintenance of Grounds 
(4220) Maintenance of Building 
(4230) Maintenance of Equipment 
(5000) Fixed Charges 


2,250 
9,375 
9,800 
2,100 
490 
196 
* 7,350 
1,525 
,2,609 


• 

1,000 • 


525 


2,250 
9,375 
9.800 
2,100. 
490 
196 
7,350 

2.609 


Subtotal , ^ 


35,693 


1,000^ 


5?5 


34,170 


Proration of All Other Expend, by Time 
Spent in Nonoccupa. & Occupa. Areas 




17,085*. 


17.085 




Total Supportive Services Expend, by Type 
of Expenditure ■/ ^ 


35,695 


18,085 


17,610 




Total Current Cost of Training in Program 
Current Cost of Train. Per Pupil - Beginning 

Enrollment 
Current Cost of Train. -Per Prog. Completor 
Current Cost of Train. -Per Avg. Daily Mbrshp. 
instriictional Services-Cost Per Student 
Instructional Services-Cost Per Student Hour 
Supportive Services-Cost Per Student 
Supportive Services-Cost Per Student Hour 


. 142,987 

• 1,906 
2,270 
2,383 
1,430 
1.99 
476 
.33 


82,082 

1,094 
1.303 
1,368, 
853 
1.19 
241 
.33 


60,905 

812 
967 
1,015 
577 

.80 
235 

.33 





TABLE 2 

REGULAR DAY PROGRAM OFFICE 
Program Code (00004); Dept. Code 1400 



Expenditures 



Instructiotial Sennces: 

(2100) ^ 

(?200) 

(2300^01) 

(2300-04) 

f23aO.G5) 

(2400) 

(2500) 

(260001) 

(2600-05) 

(2700) 

(2800) 
• (2900-01) 



Supervision , 
PrincipaPs Office 
Professional Salaries-Teaching 
Contracted Services-Teaching 
Supplies Teaching 
Textbooks 
Library Services 

Professional Salaries Audio- Visual 
Supplies Audio-Visual 
Guidance Services 
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Psychological Service: 
Professional Salj 
(2900-05) Supplies-Ed. TV 
Other Instructional Expenditures 

Subtotal 

Proratjon of All Other Expend. By Time 
Spent in Nonoccupa. &. Occiipa. Areas 

. Total Instruc. Services Expends by Type of 
Expenditure 

Supportive Services: 

(1000) Admii>istrative 
(3000) Other School Services 
(4110) Custodial Services 
(4 1 20) Heating of Building 

(4130) Utility Services 
(4210) Maintenance of Grounds 
(4220) Maintenance of Building 
(4230.) Maintenance of Equipment 
(5000) Fixed Charges 

Subtotal ^ 

^ Proration of All Other Expend, by Time 
Spent in Nonoccupa. & Occupa. Areas 

Total Supportive Services Expend, by Type 
of Expenditure • ' ^ 

Total Current Cost of Training in Pr6gram 
Current Cost of Train. Per Pupil Beginning 

Enrollment ' 
Current Cost of Train. -Per Prog. Completor 
Current Cost of Train. Per Avg. Daily Mbrshp. 
Instructional Scrvices-Cost Per Student 
InstructionaLServices-Cosl Per Student Hour 
Supportive Services-Cost Per Student 
Supportive Services-Cost Per Student Hour 



)letprs ~ 121 Students 






ership - 108 Students 








(1) 


(2) A. 


(3) 


f7^/ Types of Expenditure?\ 


i • — y 


Occupa- 


Nonoccup;^ 


All Op£^ 


Total 


tional 


tional . v 


$ 6,750 


S 750 


S 6,000 


$ 








9,900 


72,532 


32,000 


40.532 - 


♦ — 


13,500 




1 "X i^nn 

, 1 J,DUU 




7,550 


800 


6,750 




5,900 


500 


5,400 












2,700 






2,700 


1,350 






1,350 


*5,400 






5,400 


2,835 






2,835 


2»700 






2,700 


2,350 


1,000 


1,350 






1 if n 917 


35 050 


73,532 


31,635 




10,545 


21,090 




140,217 


45,595 


94,622 




4,050 






4,050 / < 


2,700 






" 2,700 


17,562 






17,562 


3,804 






3,804 


878 






o7o 


351 






1 C 1 

JDl 


13,172 






13,172 


<' r,o5o 


100 


950 




4,725 


- ■ 




A T 1 C 

4,725 


48,292 


* 100 


950 


47,242 




« 

15,747 


31,495 ' 




48,292 


15,847 


32,445. 




188,509 


61,442 


127,067 




1,396 


455 


941 




1,558 


508 


1,050 




1,745 


569 


1,176. 




1,039 


338 


701 




.97 


.32 


.65 




358 


117 


241 




.25 


.08 


.17 
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mix iy\ training taken In students in tlio 
protliain. hi-tnu ti.^tul vt'n"/\t expondi- 
t'.ni's tend to iLwinnate in aitivinp; at tlie 
total ^ c iUit'iit c wst ut ttaining and the 
caK Illation Lunent i i>sr n\ tniininu; per 
pupil. Adjustment beginning enri)ll 
nient t<>r prwgrcini Li>nipleturs and ADM 
vause the eost of tr.iiniiig per pupil to 
increase substantJalU . 

Table 3 presents the noniK cupational 
tu adeniie proi^ran^ regular dav pro 
gram cUea. It provides expenditure infur 
tnatiitu DM students who are f)nly taking 
aeadeniii {raining. As in the i)eeupational 
programs pre>ented previously, total eur 
i ost c an be derived by summing 
iN'^tnii tii'U*il ^(-/f*/V{> and >///>/>(»/ nVe sc/ 
i7tt>-^ I he current tost ot training per 
pupil ean be derived based on beginning 
enrollment alid ADM. In.struetioiial and 
supportive serviee expenditures can also 
be determined on a per student and per 
student hour basis. 

A brief review of the previou.s tables 
indicates that there are substantial dit 
tereiices in the current cost of the 
individual prt)grams (both occupatii^nal 
and nonoccupational) witlnn the same 
se-lu)ol. I'lns is the usual case and the 
present reporting systems are typieallv 
not able to detect iliese differences within 
program areas. MI.SOE CIXS wUl be able to 
describe these dif fer^*^;^^. besides pro- 
viding coniparisons over iTttH vidua 1 pro- 
graijis within the same school. (!ompari 
sons can also be made in the same school 
bv. instructional ^i-rvicc^ and supportive 
Si rriccs expenditures, by occupational 
and nonoccupational expenditure, type, 
by cost per pupil rf)riginal enrollin.ent, 
convplctors, and ADM; and cost per stu- 
dent hour of instruction for instructional 
services and sup port iv^^ services expendi 
tures. • . , . 

MISOECDS would ftlso allow educa 
tional ailministrators tg make a cost 



comparison between sclu)ols, by program, 
by school type, by sclu)i)l size, over 
region-, etc. For example, 'I able 4 presents 
the per pupil current ctxst and eitrollment 
data \o\ six different a)CCUpational 
programs ii. comprehensive secondary- 
schools acre ,s the state. This table shows 
that substa itial differences exist in the 
cprrent cosv of programs wntliiii schools o\ 
the same typt. 

l.stijfuitifii^ ( dpitdl Cost for MIS( )!' ( 7).S* 

Capital cost consists of land, building(s) 
and equipment, plus an imputed rent 
^opportunity cost) for the use of public 
funds for these purposes. Ho\yeYiL:r,Jicriaiis. 
problems jtxist in attempting to measure 
the cHpitru cost of education. For in- 
stance, should historical costs, replace- 
ment costs, or current assessed valuation be 
Used to measure the capital costs? Each ot 
the above is subject to some limitations. 

An ahvrnative technique that can be 
used in estimating the capital cost is the 
"capital recovery factor'' ((^RF). The use 
of this technique can account for botli 
rent (interest ) »uid depreciation. 

The capital recovery facti>r is the factor 
which . . when multiplied by the 
present value of capital costs, is the level 
- average 1, endof yeaV annual anu)unt i)ver 
till* life of the project necessary to pay 
interest on and recover the capital costs in 
full (Hirshleife'f, 1960). 

This formula is is follows: 

5x)i(l +i)" 

/ • is: 'f. 1^ ' ... - 



when c is the. capital recovery factor 
(annual capital cost): ^^() is the present 
value of capital in use: 1 is the social 
opportunitv cost rate of capital or invest- 
ment funds: and n is the number of years 
(the life of project) over which benefits 
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TABLE 3 
KE(;ULAR DAY PROGRAM AREA 
Noiujccupatunial f Academic ) Program 
Beginning Enrollment = 393 Students 
Average Daily Memberi.hip - 314 Students 



Expenditure^ 



Instructional Services: 



(2100) Supervi>U)n 

" ' 2200) Princ ipaPs OlBce 

(2300 01} PrDteshional Salaries Teaching 

; 2300-04) Contracted Services Teaching 

( 2300-05 ) Supplies Teaching 

(2400) Textbooks 

2500) Library .^''rvices 

f 260(y 01 ) Professional Salawies Audio Visual 

'2600 05) Supplies Audio Visual 

(2700) (Guidance Services' 

2800} ' Psychological Services 

-r— (2900-Ot ) Profe. ' ^Monul Salaries . B 4.-TV— 

2900-05 ) Supplies-Ed. TV 
Other instructi(ynal Expenditures 

Subtotal 

Proration oF All i.)cher Expendi by Time 
Spent in Nom^ccupa. ik Occupa. Areas 

TiJtal jnstriic. Service^ Expend, by Type 
of Expenditure 

Supportive Services: 

i 1 000 I Administration 

(3000) Other School Services 

<4110) . (-ustodial Services 

(4120} Heating ot Building 

(41 3f)) - Utility Services 

'4210 ' Maintenance of ClroiUuls 

4220; Maintenance of Building 

(4230} Maintenance of Equipment 

;5000} Fixed Charges , 

Subtotal 

Proration of All Other Expend, by Time 
Sjpent in Non occupa. Occupa. Areas 

Total Supportive Services Expend, by Type 
of Expendit»/«e 

Total C:urrcnt C**ost of Training in Program 
Current Clost of Train. Per Pupil Beginning 

Enrollment \ 
Current Cost of Train. Per Program Completor 
Current Cost of T|:ain.-Per Avg. Daily Mbrshp. 
Instructional Serviccs-(!cyst Per Student 
Instructi(mal Services C>.>st Per Student Htmr 
Supp<)rtive Services ('ost Per Student 
Supportive ServicesCost rei Student Hour 



Total 




ypes of Expenditures 



Occupa- 
tional 



$ 19,650 
29,082 
170,991 
39,300 
19,650 
15,720 
19,650 
7!860 
3,930 
15.720 
8,253 

3,930 



Noiu)ccupa- 
Honal 



367,596 



367,596 

11,790 
7,860 

51,125 

11:075 
2,555 
1,022 

38,345 
2,767 

13,755 



140,294 



140,294 



507,890 



S 19,650 
29,082 
176,991 
39,300 
19,650 
' 15,720 
19,650 
7,860 
3,930 
1 5J20 
8,253 
7,860^ 



3,930 



367,596 



367,596 

11,790 
7,860 
51,125 
11,075 
2,555 
.1,022 
38,345 
* 2,767 
13,755 



140;294 



140,294 



507,890 

1,292 

L6I7 
935 

.65 
357 

.25 



<3:> 



All Other 
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TABLE 4 

PER PUPIL CURRENT COST AND ENROLLMENT DATA IN INDIVIDUAL ' 
PRjCXJRAMS IN (^OMPREHFNSIVF SECONDARY SCHOOLS ACROSS STATE' 







1970 


1971 


1972 


1973 


1974 


Auto Mechanics ^ 


ac/p 


$1565. 


$1590. 


^ $1575. 


$1575. 


$1560. 


(17.03.02) 


enroll 


500 


600 


700 


800 


900~ 


Hlucprint Reading 


ac/p 


S1350. 


$1402. 


$1515. 


$1687. 


$1809: 


^17.0500) 


enroll 


332 


350 


370 


461 


501 


Ciirpenters 


ac/p 


$1275. 


$1300. 


$1318. 


$1402. 


$1515. 


(I7.iq01) 


enroll 


1002 


980 


980 


910 


850 


Electric ill 


* ac/p " 


$1488. 


$1550. 


$1575. 


■ $1670. 


$1611. 


(17.1002) 


enroll 


1500 


1400 


1375 


1550 


1605 



Fabric Maine. Service 

(17 J 600} 



ac/p 
enroll 



$1005. 

200 



$ 995. 
210 



$ 990. 
205 



$1007. 

250 



$1101. 

260 



Consumer Educati«>n 
(09.0104) 



ac/p ■ 
enroll 



$ 900. 
1010 



$ 905. 
1100 



$ 907. 
. 1210 



$ 910. 
1400 



$ 928. 
1600 



are returned. Even this technique is sub- 
ject to some limitations. For instance, 
beside the problem of ^establishing the 
present value of the capital in use, arbi- 
trary judgments must be made regarding 
the values of n and i. 

In the MISOE Census Data System, the 
Superintendent of Schools is requested to 
Complete a table entitled **Supplementary 
Expenditure Information" in the Fall at 
the year. This table provides most of the 
necessary information (the year(s) the 
school was built and/or added to or 
remodeled and the cost of land, buildi'ng, 
and equipment associated with each of 
the above)' for computing the capital 
recovery factor (CRF) for each school in 
the community that offers occupational 
education programs. However, it is still 
necessary to make judgments as to the 
value ot the social opportunity cost rate 
of capital (i) and the number ()t years over 
which benefits are returned (n) for each 
school involved. These problems are not 



overwhelming, and realistic estimates can. 
be made for values of (i)' and (n). Thus, 
the CRF can be used to calculate an 
implicit reftt, for each school that offers 
occupational training programs. Dividing 
• the implicit rent for the schoC^ by the day 
school enrollment will provide ail4mpHcit 
rent on a per pupil basis. The enrollment 
in day occupational programs can be 
multiplied by the implicit rent per pupil 
to obtain the implicit rent for the; pro- 

The addition ot implicit rent to the 
current cost x)f educational programs will 
provide estimates of total program cost 
and total cost per pupil in the program. 
Substantial differences can be expected to 
occur in the implicit rent charges, the 
total program cost of each program, and 
the total cost per pupil of each school. 
However, it must be pointed out that the 
per pupil implicit charge is the same for 
all students in the school for all 
program areas. Also the normal pro- 
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cedure is to charge implicit . rent only 
ito day school program areas and not every \ 
student in the school. 

listimatut^^ Proj^ram (.oVf I-or MIS( )}':~Sl)S 

In MISOE-SDS expenditures must be 
-accumulated over the Hteot the 'program 
in order to determine the total cost of the 
program and* the total Cost .per pupil of 
program completors. For nistance, in. a 



three year program beginning in Septem- 
ber 1973 the yearly cost of tlie program 
must be accumulated until June, 1976. 
Table 5 (program code 00001 - auto- 
mechanics — occupational) follow the 
current expenditures of this particular 
occupational education, program., over 
three years - the length of time it takes 
to get a program completor in this pro- 
gram. The program expenditure informa- 



TABLE 5 

SCHOOL X ' 
Occupational Day Program - Automechanics 
- Program Code 00001; Dept. Code 1703 

Summary Table 



Expenditures 



Instructional Services: 

(2100) Supervision 

(2200) PrincipaPs Office 

(2300-01) Professional Salaries Teaching 

. (2300-04) Contracted Services - Teaching 

(2300-05) Supplies -Teaching 

(2400) Textbooks 

(2500) Library Services 

(2600-01) Professional Salaries -Audio-Visual 

(2600-05) Supplies - Audio-Visual 

(2700) Guidance Services 

(2800) . Psychological Services 

(2900-01) Professional Salaries -Ed. TV 

(2900-02) Supplies Ed. TV 
- Other Instructional Expenditures 

Subtotal 

Supportive Servicei" 

(1000) Admmistrative 

(3000) Other School Services 

(4100) Custodial Services 

• (41 20) Heating of Building 

(4130) Utility Services 

(4210) Maintenance of Grounds ^ 

(4220) Maintenance of Building 

(4230) Maintenance of Equipment 

(5000) Fixed Charges 

Subtotal 

Total Current Cost of Training in Program 



School Year 



'1973:74' 



3,728 
5,690 

55,388 
7,455 

18,728 
3,500 
3,728 

" 1,500 
750 
3,000 
1,575 
1.500 
750 



107,292 



2,250 
9,375 
9,800 
2,100 
490 
196 
7,350 
1,525 
2,609 



35,695 



142,987 



4,000 
6,000 
58,000 
,7,500 
19,000 
4,000 
3,80b 
1,000 
500 
3,500 
1,600 
1,500 
500 



110,900 



2,750 
9,625 
10,200 
2,900 
510 
204 
7,150 
i,375 
2,391 



37,105 



148,005 



5,000 
7,000 
60,000 
7,000 
20,000 
1,500 
3,000 
800 
400 
4,000 
2,000 
1,500 
500 



112,700 



3,000 
10,000 
11,000 
3,500 
600 
200 
8,500 
1,100 
2,500 



Total 
Program 

' Coist 



40,400 



153,100 



$ 12,728, 
18,690 
173,388 
21,955 
57,728 
9,000 
10,528 
3,300 
1,650 
10,500 
5,175 
4,500 
1,750 



3^0,892 



8,000 
29,000 
31,000 
8,500 
1,600 
600 
23,00b 
. 4,000 
7,500 



113,200 



444,092 
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ticMi tri.)ni' iMIS( )E"CI)S is tlu* basic data 
source* tor MISOE-SDS. Hovvcver, it must 
be suii lined over the length oi the pro- 
i^rain in oivlci to derue total program 
•ciirrent cost see Fable S where the total 
curre>i^ cost ot training h)r this program 
are S44>v{)02. 

Table (W provides a brC*akdown ot 
enrHjllment amtexpenditure.s (current and 
capioal; tor each year over the lite ot* the 
'priigrtiin. Enrollnicjit is presented on a 
yearly basis with beginning ^mrolhiient 
broken out into the' number ot program 
completors and dropouts ifii a full time 
equivalent basis, 1 lu- yearly current 
expcntlirure ot the program can be sep- 
arateil intcj instl^iLtional :,ervices and 
supptirtive ^ervit es. and occupational and 

implicit rent is added to the current C()st 
in order to derive, the total cost ot the 
program. Total program cost can then be 
broke out nito the portions associated 
with > prDgram complettirs and pt^ogram 
dropouts and .siimminl over the years ot 
the program. 

It is idso possible to tt)llow a cohort ot 
stud^Mits trom one year to another^^^^^* 
assign a share ot the total program cc)st to 
rheuK f'or instanj^in Table 7 the tenth 
gride studeiUs ot the automcchanics 
program are tol lowed over three vears. 
lieginning program enrollment is tor 
strictly occupational .students. Students 
not enrolled are non-occupational 
students who are taking an .occupatioiuil 
course. 'II1US, SDS has intormation ^)n 
what happened to each cohort ot students 
as they moved trom year to year through 
the program. Did they become program 
completors or dropouts? This questioi> 
can be answered by SDS. Also, program 
cost associatcil with these groups ot stu- 
dents can be broken out into tlu* portion.s 



associated with the various types ot 
completors and dropouts this is illus- 
trated in the center of Table 7. The 
bottom o\ I'able 7 illustrates how total 
prograni cost can be associated with a 
cohort ot 19 students who em'olled in the 
prograni in the teiit.li griide ( 1 973 74 ] and 
completed the program in 1975-76. The 
cost per yearly com pie tor trom Table 
7 is multiplied by the number of 
graduates to .obtain the total cost per year 
ot training. The addition ot the cost peV 
yearly co.nipletor over ^ the* three vears 
provides the per pupil average total cost 
ot training lor this cohort of students in 
tlw automechanies program. The addition 
ot the total cost per year' over the three 
years provides the total- cost ot»# training 
~Thi5;~aitrnTT"of"s^^^^^ 

• MiSOE-SDS is also working on the 
problem ot determining the cost ot 
individual terminal objective's associated 
with this prograni. In other words, total 
prograni cost could be broken down into 
the cost of teaching the .individual 
TERMOBS ottered within tlK\ program. 
^A]^jJ?^ present time this process is in the 
' early stages ot development but hopetullv 
it will become anotl^'r of the MISOE 
tools in the future. 

( oju Itisioii 

This description of' the- MISOE cost 
i^nalysis convponent concludes the discus- 
sion ot the intormation collected and 
stored in the datii tiles. The next chapter 
describes how this intornvarion is con- 
nected together tor interactive analysis 
iind should at least^be ''rapidly skimmed" 
by the reader. The development of the 
data tiles -is really the essential key to 
making an interactive, computing system 
a reality. 
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CHAPTER 6 

MISOE INTERACTIVE COMPUTING SYSTEMS 
ANQ FILE STRUCTURE 



Martin Breslow 



This chapter will probably be high on 
the **quickly sknnmed" list tor readers. 
However, it serves two important func- 
tions and they are: 

1. It provides a feel for the ''real world** of 
interactive computing systems, and 

2. Jt offf*rs a description of the enormous 
flexibility of the MISOE data files. 

This chapter is purposefully described in 
casual language, and a hiirlv rapid 
skimming of its contents should facilitate 
a reasonable understanding for dealing 
with Chapters 7 and 8. It would be 
sensible to expect that the casual reader 
might want to return to review this 
chapter after (or during) the reading ot 
Chapters 7 and 8. in fact, the^ entire 
example of policy forniuhition offered in 
Chapter 8 could be conceived as taking 
place in front of the MLSOE computing 
terminal' sketched in Figure I ot this 

_ Chapter. - 

HanliViirc and hipiit!()utput Ik-vices- 
MLSOE hardware and input/output 



devices provide for interaction between a 
manager (or user) and information files. 
The hardware and devices together are 
usually referred -to as a terminal. The 
MIvSOE computer^terminal is comprised of 
six separate pieces of hardware, and they 
are: 

1. A graphic display scope and keyboard; 

2. a printer; 

3. an acoustic coupler; 

4. a minicomputer; 

5. a cassette tape recorder; and 

6. a grapliic hardcopy device. 

The MIvSOE terminal, which could be 
described as a remote input and output 
device hooked together by electronic 
circuitry, is pictured in Figure I. 

The terminal is connected to a time- 
sharing computer on telephone lines via 
the ''acoustic coupler". The computer and 
the terminal communicate with each 
other by using devices whicli emanate and 
detect specific high-pitched sounds. The 
sound carries a code similar to the Morse 
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Primer 



C*a,ssette Tape Recorder 
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Minif^Computer 



I — — Graphic Hard Copy Devices 




code, and these pulses are translated into 
a langii<ige the terminal can understand. 

The user interacts with the computer 
by typing messages on the keyboard. The 
keys contain characters which represent 
letters or numbers f)T specific controls for 
the devices connected to the terminal. 
Certain k'eys enable the user to edit 
messages to the computer prior to trans- 
mission. The user can both delete and 
ins(-*rt characters. 

The graphic display scope operates 
tnucli like a television screen. It caji 
display tables, graphs, or any two- 
dimensioiial shape. Thus, tlir graphic dis- 
play scope can be used to colnmunicate in 
a variety of ways from the computer to 
the user. The graphic displays are con- 
trolled by the minicomputer, 

Sinuiltaneously, that which is displayed 
on the graphic display -scope is also 
displayed on another display scope with 
the graphic hardcopy device. The graphic 



hardcopy device also includes a photo- 
copy capability, and therefore the user 
can demand a hardcopy of any in forma-' 
tion he interactively develops on the 
scope. 

Interactively developed information 
that is longer than the graphic display 
scope can be outputted on the printer. 
However, extremely hjng reports 
requested by management should not be 
transmitted through the MISOE computer 
terminal, but should be requested to be 
outpUtted on a high-speed printer at a 
computing facility. 

The cassette tape recorder is used to 
prepare inputs cyr complex communica-- 
tions with the computer, prior to entering 
into a dialogue with the remote computer. 
The cassette tape recorder is helpful in 
facilitating efficiei'it communication be- 
tween the user and the computer. When 
the user is 'iogged" on to the time-sharing 
computer, the edited information on the 
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. ^ 

tape can be rapidly coPMiuuiicated over ^: 
the telfph<-)iK* lines to the computer.^ 

'I'lu Si»/fh -./rt Intt f.ii'tivc MISOI: ■ 
Si»ituaie Is another way ot describing 
^ already Cvritten lonipntcr prugrams.yThe 
interactive si.)ft\vare used by MiSOH can . 
be chissitied by three functions: 

1 . data management: 

2, data manipulation*: and 
rt-pdit generation. 

Data niaijagenient is the name whit;^! 
describ^^s the structuring process \ur the 
storeil inh)rnuitii)nvs'ystvnis such that they 
art* compatible with a process ot inter- > 
active retrieval/ The st)ttvvarc packages 
avaihd'>Ie Un perU)rmii}g these t unctions 
provide a technical hingiiage tor specifying 
and editing the data; as vyell as a language 
tor retrieving information. The retrieval 
hiugiHtge alscuincludes some ot thi- report- 
ing and datii manipulation capabilities. 

The structure the Ml.SOE data files 
will be discussed in a later section ot this 
chapter. Sfiace limitations do not permit a 
description ot' the retrieval language. How- 
ever, chapter 7 Avill provide the reader 
with a gefK-rali/able description ot how a 
. user can interact with the' MISOE data 
system. This chapter will also discuss the 
iogicaU mathematical, and statistical 
information manipulation operations that 
are available tor interactive analysis on the ' 
part of the user. Statistical operations are 
performed by an interactive-statistical 
package. Requests for statistical analysis 
are nuule in a conversationah trec-torm 
language. 

Special softw^are is required to trans- 
form outputs from the data base manage- 
ment package and the statistical package 
into a^form such that it can be displayed 
to the user on the graphic display scope. 
For tabular output, this is straight- 



The three types of software packages 
(data management, statistical, and 
graphic) are connected^ together by a 
conversational 'time-^sharing system. The 
tiiUl^sharing system includes an executive 
language in which requests involving the 
use of two or nuire ot the sohware 
packages* can b*e automated. Thus the 
process of going frcnn t^je data manage- 
ment package to the staCi^jtical package 
and tt) the graphic package tflin be greatly 
simplified for the user. % 

Conticctihility of iXUw illcs The 
fulfowing section of this chapter will 
present, a general overview ot how the 
MISOE data files are organized for inter- 
active analysis. This presentation will be 
more conceptual than actual, but is 
designed to help the reader understand 
the relatively uncomplicated nature ot 
data tile organTy.ation. In general, wheii a 
data base is created, intormation is read 
into a storage file with several descriptive 
fields. The process of storing information 
within an organized data tile uses descrip-. 
tive information on each data itL^n in, 
establishing ccMinections among data items 
and across separate files, Cerfain data 
names i\Tc declared as "classiticrs'' 
(qualitative variables in (Chapter 7). For 
example* an occupational education pro- 
gram can be classified by an ID number, a 
USOE cyde, or ;i nundxT which identifies 
the ta\\n\ and school in which the program 
is offered. These ^Y'lassifiers" connect 
data across data units, while data names 
Called *MdentituM"s'\ tor example, a 
student's identification number, can 
conuL^'t together all informntion tor a 
particulnr .student (a data unit) within an 
organized data tile. 

Cofuicctihility Within the ,\IlS()i:(:i)S 
SDS Data l'iU\< This section will brietly 
describe the structure t>f the MISOE data 
t'lles, highlighting' its connectibility. File 



forward, f-c^r graphic output, sottware is 
necessary to s|/iecity scales along the axes. 

^ AhlKuigh IVil.SOE was initially developed with a^hardware configuration described by F-igure 1, 
there are ccmmiercially available , alternatives whose construction slightly alters the de.scribed 
contigurationr. # 
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structure to attain maximum data con- 
nectibilitv is absolutely essential to an 
interactive Ci)mputing system. 

Figures 2, .3 and 4 describe the Hie 
arrangements of the MISOE Sample Data 
System. 

In Figure 2 the first row on the upper 
left hand corner, described as 'Basic Data, 
contains inforniatioH idejitifying certain 
static coniponents\)f the students in the 
sample. PID stand^N^or Permanenfldenti- 
fication Number and every student, 
teacher and administrator in SDS is 
assigned a unique PID. A student's PID is 
an identifier or classifier. The student's 
PID connects -together all basic and IPPI 
information on an individual student. 
Figure 2 simply sketches these connec- 
tions. The second row, contains a stude'nt's 
Input Data, the third row is Process Data, 
.the fourth row is Product Data and the 
fifth row is student's Impact Data. Notice 
it is all connected together by a PID. 

Each program, from wliich students are 
sampled in the .Sample Data System is 
assigned the same ideijtification number it 
carried in the Census Data System. This is 
called the PFID. Census Data System 
^information describing certain charac- 
teristics of the programs froin which 
sample students are taken are connected 
-to the PFID. Thus, information describing 
the > individual student 4is arrayed in the 
left hand side of. Figure 2 and intormation 
which describes certain characteristics ot 
the program from CDS information can 
be connected together. This is a partic- 
ularly crucial connection for expenditu/e 
information. 

To help unscramble Figure 2, it might 
be useful to know that most of the- 
abbreviations describing the input bat- 
teries stand for specific instruments; CN 
represents cohort number; and WTS 
describes the space where sample .weights 
will be attached to each student file, such 



that the user never will be able to 
access unweighted information. Figures 3 
and 4 display the layout tor the data 
files for teacher and administrators. 
Note that the PID serves to connect, 
together each teacher's and adminis- 
trator's data. Student information is con- 
nected to teacher information (but not 
vice versa), by way of the PFID. Student 
data is connected to administrator data by 
way of a system school codjj which is 
adopted from the CDS system. Thus, the 
inforrhation describing tpachers ^ and 
administrators becomes extensions of 
student process information. 

The SDS data files have been designed 
such that student information is con- 
nected to program, teacher and adminis- 
trator data, but information describing 
programs, teachers and administrators 
cannot be connected back to students. 
That is, these connections are one-way. 
Further, teacher information is not con- 
. nectcd to administrator information. This 
provides ;1 teclmical safeguard against 
using MISOE information to "evaluate" 
individual schools, teachers, or adminis- 
trators within the sample. 

On the other hand, information in CDS 
is all *'two-way connected" (on the 
assumption it is public information). 

Figure 5 is a grapliic presentation of the 
CDS Data file. The following description 
of the CDS data file assumes that each 
of the abbreviated identifiers within this 
scTiematic layout is self-explanatory. 
,LEAs are ide^itified by a system code, a 
unique number assigned to^ach LEA. 
Since the system code is pr^ent on all the 
CDS files, it forms the basis for con- 
necting LEA information to all other data 
in the file. ^ * 

. Three digits are added to the system 
code to form a ^'system and individual 
school code", which ident'ifies a school 
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within an LEA and ties together an 
individual school's data. All the CDS 
information describing a particular 
cfCcupational education program (row 4, 
%ig*ke 5) and the information describing 
occupational education 'stait members 
within a school (row 3, Figure 5) contain 
the school's identifying code number in 
the individual files. This cross-Hie con- 
nectibility allows a user to interactively 
analyze programs and teachers by school, 
and ' permits a display of information 
describing, the school in which an occupa- 
tional education program is nested. 

: The identification cbdes (PFID) of the 
occupational education Jbrogram(s) a staff 
member teaches is storeS^-with his inior- 
mation. Furthermore, the identification 
numbers of the individual student groups 
''(GID) he teaches within each occupa- 
tional education program is also stored 
•within the teacher's file. Thus, informa- 
tion describing teachers is connectible to 
progratn enrollment information. Since 
student groups are defined by grade and 
USOE code combinations, occupational 
education staff can be classified by grade 
and USOE code. * 

The program ■> file contains a Depart- 
ment ID in addition to various codes 
named above. T^ius, when a department 
has more than one occupational education 
program, they can be separately classified. 

( Ayncliisioii 

It is hoped that this chapter has 
communicated an uncluttered con- 



ception of two important elements of 
MISOE: 

1. The physical hardware with which a user 
must come to grips, and 

2. The sco||^ and flexibility of the data files. 
It is not necessary for a user to ever know 
much more than is presented in this 
chapter about file structure and hardware 
to interact with MiSOE data systems. As a 
matter of fact, it is not necessary to know 
anything about the structure of the data 
file layout. However, an overview of the 
file structure could be helpful in under- 
standing the analytical flexibility of 
MISOE. 

Chapters 7 and 8 describe the very ' 
essence of MISOE. Chapter 7 stipulates * ,' 
how a user can interact with the MISOE 
data systems in policy formulation, while 
Chapter 8 presents an example of the 
development of, a statewide policy for 
occupational educatiorf. 

In order to judge the usefulness of 
MISOE as a support mechanism to policy 
formulation, it is necessary for the reader 
to experience, at least vicariously, policy 
development with an interactive comput- 
' ing system. Chapter 7 provides an outline 
of the few specific skills required to access 
the MISOE data systems through data file 
indices, while Chapter 8 is intended to 
'provide a feel for interactive policy 
formulation. Both chapters should .be 
rather carefully considered by those 
concerned with evaluating the potential of 
MISOE in making better man's capabrnt^lT 
to formulate policy^ for occupational 
education^t the state level. 
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^CHAPTER 7 

INTERACTING WITH MISOE DATA^ 
OPERATIONS AND OUTPUT INDICES 



Elizabetli Weinberger 



Intnnlifctiou 

The hict that MISC)^ is an intcnictivc 
computer system has been stressed many 
time's earher in this Journal. What does it 

.jnean to interact-with a computer system 
fmm thp point of view of the educational 
manager? How does one go about inter- 
acting with a computer? What are the 
benefits that can be derived from such 
interaction? it is the purpose of this 
chapter to attempt to provide response to 

'questions. such as these. The chapter has 
been divided into two parts. Part I is 
concerned primarily with introducing and 
explaining the tools provided to the edu- 



cational manager for interacting with ^le 
M1SC)£ system. These tools are: the tliree 
types ot indices to the system that pro- 
vide coded listings of the data available; 
the operations that can be performed on 
this data; and the types and modes of 
information outputs available. The second^ 
part of the chapter provides several ex- 
amples of the interaction process and is 
essentially geared towards demonstrating 
how this process might work. Since the 
man-machine interactive component of 
MISOE is still in the' developmental stage, 
this description of the process is meant to 
'be suggestive rather than descriptive of 
le final product. 



PART I: A DESCRIPTION OF THE MISOE INDICES 



A IhiejOvcrview of the MlSOli IXitli and 
( )pi'ratio}i.< bill ices 

There are three types of indices to the 
MISOE interactive computer system: 



{]) 'rlic Data Indices. (2) The Operations 
Index, and (3) 'The Output Index. The 
Data Indices contain hierarchically 
ordered listings of the major data classifi- 
cations stored in the MISOE data Piles and. 
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their respective cdcIo numbers. Since there 
are tvvi) major categories oTMISC^E data. 
(l^S data and SlVs data. tvvr» sepaVatv 
Data Classitication Inchces were 
developed: ilic ( DS L.Lissi jicdtioit 

hhh'x and the. SDS Ddtu i ldssificdtioii 
hhlt'X. Each ()t these is turther sulxhv/Ject" 
into a Quahtative Variables Index anol 
(^uantitive Variables Index. Tlic Opera 
riofis lutlcx contains a coded listing ot the 
various operations that may be pertornied 
For purposes of analysis, retrieval antl/or 
dis1[>lav on stored inK)rniatit)n for selected 
variables listed on either the C'i)S t)r SDS 
Data Cliassitication Indices. The Opera 
ticnis liidex is divided intt) three sections 
which reflect the types of operations 
accommodated by the system: l.o^iicdl 
()pct:dtion.<, MfdtliciUdticdl ( )pcrdtio}is and, 
Stdtisticdl 0^)fWi^^. 'ilw Output bult'x 
prt)vides a coded listing of the various 
ty^x's and modes of output t)f retrieval 
information that can be requested by the 
user of the system. The purpose of this 
chapter is firstly to prt)vide th<? potential 
user of* the MISOE ii^teractive computer, 
system with a description t)f the majt)r 
indices to the system, and s^x-ondly, to 
provide the potential User with an under- 
standing of the prt)cess by which one can 
interact with the MISOE computer system 
through the use of these indices for 
purposes of analysis, retrieval or display 
of* information. 
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littioilitction fi' the / >r (>/ the 
J)S and SDS l)dtd\Jd.<.<ipidtiou 



As prev/ously mentioned, there are two 
Vata classification indices: the (!I)S Data 
Classification Index and the SDS Data 
C/lassificatioVd Index. ' rhe data classified in 
fach of* thesextuHces is d^<Tttrtl into one of 
/wo data types: 



1. (ituditutiVe Data is that coded qualitative 
information upon which only logical (i.e., 
nonnuithematical operations can be per- 
formed. Examples ot" quaHtative variables 
are: »»e\, race, school type. Qualitative 
variables are primarily useful in classifying 
data for purposes of distribution or ag- 
gregation. ^ 

2. (iuantitative IXitu is that coded quan^ 
tltative information upon w^hich both 
logical and mathematical operations can be 
performed. Examples of quantitative vari- 
ables are: number of students enrolled in a 
.given program, average number of hours 
per week that a given program is taught, 
number of full time tionteaclnng staff in a 
given UEA, 

The CD^ and SDS Data Classification 
Indices are each divided into two parts: a 
Qualitative Variables Index and a Quanti- 
tative . Variables Index. Thus, there ;vre 
actually four data indices, Eacli data 
index is accompanied by a Table of 
Conteats which lists the major variable 
chussifications included in tluit index by 
identif*yi.ng ct)de number and page loca- 
tion, (Kce Figure 1), The Table ot Con- 
tents has been organized for the purpose 
of data retrieval' and is a truncated but 
.representative poi^ion of the Table of 
eContents to the CDS Qualitative Variables 
Index and is shown on page 76, Thus, an 
educational manager who was interested 
in h)cating information on occupational 
education staff members from the CDS 
Qualitative Data index would knew tluit 
the data classification for **0. E. Staff*' is 
located on pages 14-15 of that index and 
is identified by code numbers in the 4(X()'s 
range, . 

The CDS and SDS Data Chissification 
indices ct)ntain hierarchically ordered and 
coded breakdcwns of the data classi- 
fication categories listed in the ac- 
ccMnpanyin^ Table of eContents, The 
coded " subcategories are alphabetically 
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FIGURE 1 DRGANIZATION OF THE MISOE DATA INDICES 



CDS 
Quantitative 
Data Index 



CDS 
Qualitative 
Data Index 



CDS 
Data Index 



Table of 
Contents to 
CDS Data Index 



SDS 
Quantitative 
Data Index 



SDS 
Qualitative 
Data Index 



SDS 
Data Index 



♦ Table of 
Contents to 
SDS Data Index 



Data — 
Category 



Data 
Subcategory 



Table of Contents to the CDS Qualitative Variables Indbx 


Major Data Classifications 


, Code No. 


Page No, 


^Organizational and Geographic 
System/School Codes 
LEA Types 


300 
301 
302 


12-13 
12 
13 


Occupational Education Staft 
— ^Teacher/Teacher's Aide 
Fulltime/Parttime 


^ 400 
402 
403 


14-15 
15 
15 


USOE Codes 


500 





Major Categories of CDS Qualitative Variables by Code Number 



Organizational and Geographic Breakdowns . 300 
Occupational Education Staff VJ 400 

USOE ('odes and USOE Code Categorizations 500 
TERMOB Related 600 
Miscellaneous 700 
' Economic ^ 

Enrollment, Student and Other Staff Oriented 

Instructional Area 

Time Related ^ 

Other 



701-710 
711-720 
721-730 
731-740 
741-799 
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orciered within each the .major data 
chissificatiiin categories. Each ot the Data 
Chissitication Indices is individuallv- dis 
disced ni the tollowing section. 



Tiw ens 



K.,. . 

(j^llillltJtlVt' 



I 'dri.ihlt's IXitd 



The major data chissiHcatiom inchided 
in'tlie CDS Qualitative Variables Index 
and their respective coded numbers are 
summarized- on page 76. To use the CDS 
Qualitative Variables Data Chissitication 
Index, the user would tirst reter to the 
'lable o\ Contents For this index, as 
previou.sly described, and find the-^page 
number and code number ol" the parti-c- 
ular qualitative variable in which ht; was 



interested. 

Suppose that the hypothetical educa- 
tional manager mentif)ned earlier is ititer- 
ested iii intorniation on occupational edu- 
cation teachers with jVlaster's Degrees. He 
would consult the Table of Contents to 
CDS (Qualitative Variables (see page 76) 
where he^ would Find that occupational 
education statF variables are located on 
pages 14-15 of the .Qualitative Variables 
Index and are identitied by code nunibers 
in the 40()'s range. He would open the 
CDS Qualitative Variables Iijidex to the 
specified ' pages ' and look i\i the list ot 
variables with code numbers in the 400's 
range. A representative section oi this 
index is illustrated on this page. He would 
Fiijd that code number 407 identifies the 



Representative Section of the CDS Qualitative Variables Index 

400 

405 



Occupational Education Staff 
FuUtime/Parttiuie 
Fulltime 
Parttimev 



Highest Level pf Educational Attainment 
Bachelor's Degree 
Bachelor's Degree + 30 credits 
Master^s Degree 



'407 



405.1 
405.2 

407.05 
407,07 
407.07 



data category Highest Level of Educa- 
tional Attainment. Since the intorniation 
that he is interested in Falls within this 
data category, he would then look at the 
data subcategory until •HiKHng the par* 
.ticular qualitative varrable category in 
which he is interested (i.e., ()E teachers 
with Master*s Degrees). Code number 
407.07 identifies the category Occupa- 
tional Education Teachers with Master's 
Dfe^grees. Thus, he would specity code 
number 407.07 to obtain data within that 
category. 

rlic CDS (^ndfititativc l\inahlL',< Iktt,} 

The major data classiFications included 
in the (!DS Quantitative Variables Index 



/ 

and their Respective code 
summarized below: 



nu 



ml 



^crs are 



Major Categories of CDS Quantitative 
Variables by Code Number 



Expenditures 

Enrollment 

Staff 

Instructional Area 
Student Time 
TERMOBS 



1000 
2000 
3000 
4000 
5000 
(5000 



The CDS Quantitative Variables Index 
would be used in much the same way as 
the CDS Qualitative Variable Indices. Tliat 
is, the user would first refer to the Table 
of Contents to the Index with a particular 
data classiFication in mind and then to the 
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nuli*\ JtNi it to tiiul tilt* cudt' luunlHT that 
KUMUilii-s titc paitiv.ular variable catL'gory 

sjvcitv tiiat c^hIc luunhci to obtain the 
ili'sried in^<jrniatii»n. For c\aiupk\ an tnlu- 
<.atii»nal niaiKigcv mighr he interested in 
kn*»\vn!g the enr»»Hnient \A each eompre 
jiciiMvc hi^h sciujol in Massachusetts. 
Siut r tlu- data in whitii he is interested 
cnr'»Hnu*nt is the quantitative type 
a!ul \s ( DS data, hi; would reter to the 
I'aMe oj[ Contents ti» the (!I)S Quantita 
t!ve \'aiiables Indev. There he would Hnd 
■ tiu' l'» ..|h iw.inv; discing; 

nn If A^ • ^ZMn iMn) 8 

(Jri Ov.up.iri'M»al Dcpaituicntr 2101 21^)9 9 10 
On up.aum.il Frugranis 2001-2099 11 

nitS.h.Ma. 2201 2299 12 

♦ . — . — , — . — _ — 

In that iie i> interested in enrollment data 
r»n swhtnils. he would then turn to page 12 
*.>t the CDS (Quantitative Variables Index 
And w»»uld look at the vatiables coded 
22»H 22*^^>. He Would Hnd the following 
hsting tor variables in which he is inter- 
ested, enrollment in schools: 

22ul Number ot Sm*k*nts in Sthool 

In^tutitioHiil^'^^otf : SpcciK* Sclmol Selectors 
QV 3*«ni . (ii-ulc QV 308 . Race QV 711; 
und Sc\ QV 715; may be speciBed at tlu' 
user's option 



riii^ri'tore, lie wtiuld know that he must 
specitv code number 2201 in urder to 
t»brain the data in which he is interested. 
The njstructit)nal note accompanying this 
.data itt^m provides a listing of the addi- 
ri«>nal data specifications that must or can 
be !nade in order to obtain the intorma- 
tion desired. The CipS Major Data Selec- 
ti'ts Summary Sheet see 'I able I) contains 
a voded listing of the major" qualitative 



variable categories by which CDS data 
items can be qualitied or classified. Since 
the manager is interested in enrollment in 
comprehensive .seci)ndary schools, he 
would know that he must specify a 
School Selector identifying the School 
I'vpe. i.e.. iloniprcUinisivc Seco}uLiry. 
From the Major Data Selectors Sunnnary 
Sheet he would note that School Type 
data is identified by code numbers in tlie 
range ot^ 303.00 in the C:DS Qualitative 
Variables Index. By using the Table of 

TABLE 1 C:DS major DATA 
SELECTORS SUMMARY SHEET 

QV-301A System Selectors 

QV 301 System/School Code 

QV 302 LEA Type 

QV 315 . State Senate Districts 

QV 316 State Assembly Districts 

QV 317 U.S. Election Districts 

QV318 SMS As 

QV 319 Educational Region 

nV-301U School Selcctor.< 
QV 301 • System/School Code 

QV 303 , School Type 
QV 313 School Organization 

QV 301 A System Selectors 

BV 305 Department Selectors 
QV 3()5 Department l.D. 

QV 301 A System Selectors 

QV 301 B School Selectors 

BV401 Staff Member Selectors 
QVs401-40y: 411-413 Staff Characteristics 
QV 30S Department l.D. 

QV 30() Program Selectors 

QV 401 A&U System Sel(*ctors and School 
Selectors 

BV-306 Proj^ram Selectors 
QV 306 Program '(Form) ID-(PFID) 

QV 309 Program Type 

QV 311 Program Area C!odes 

QV 312 Codes of Program Area Distri- 

bution (Legal Cfassification) 
• QV j320 Program Is/ls not in SDS 

" Example 
QV 305 , Department l.D, 

QV 500s ' USOE Code combinations 

QV 301A System Selectors / 

QV 301 B School Selectors 
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Contentri to this index, he would Hiid the 
pagefs) in the index on which data items 
witii that code are hsted. In the index he 
woiUd find that code number 303.20 
identities the data chissiHcation Clom- 
prehensive Secondary Scliool. That is the 
School Selector that he vvt)uld specity. 
Thus, in order to obtain data on the 
enrollment ot each comprehensive high 
school in Massachusetts, the manager 
would specity two numbers: 2201 and 
30.3;20. This is a very simple example tor 
demonstration purposes. 

SDS Data C Jas.^ification Indices 

As previously mentioned, the SDS and 
CDS Data Classification Indices are 
similarly organized. That is to say that 
there is an SDS Qualitative Variables 
Index with an accompanying Table ot 
Contents, and an SDS Quantitative Vari- 
ables Index also accompanied by a Table 
of eContents. Since the SDS data indices 
are used in nmch the same manner as the 
CDS data indices, this section ot the 
chapter will be geared toward detailing 
the content of these indices rather than 
their usage. 

l1ic SDS (^ucilitativc \ 'ariahlc.< Data (lissi- 
fication hidcx 

The major coded data classitication 
included in the SDS Basic Variables Index 
are summarized below: 



rlic SDS UKantitativc 
CLKsificatioii htdcx 



I ariahlcs Data 



Maji)r Categories of SDS Qualitative 
Variables by Code Number 



Cohort Number 

Grade 

Level 

Stratification Cell Number 
USOE Code Number . 
TERMOB Number 



100 
200 
300 
400 
500 
600 



The major data classitication included 
in the SDS Quantitative Variables Index 
and their respective code numbers are 
summarized below: 



Major Categories of SDS Quantitative 
Variables by Code Number 



Input Data on Students 1000 

Process Data on Teachers 2000 

Process Data on AdministTiitors 3000 

Process Data on Students 4000 

Product Data on Students 5000 

impact Data on Students 6000 

Economic Data 7000 



SDS data, like CDS data, is hierar- 
chically organized. Thus within each ot 
these major data categories there are 
subcategories and within each ot the 
subcategories there are further break- 
downs. The subcategories tor all ot eco- 
nomic data consist of listings tor the 
instruments used to obtiTin the data. 
These instruDients tall into one ot two 
categories: cumirnercially or otherwise 
available instruments and instruments 
dcR* loped in ho use. For the commercially 
or otherwise available instruments (indi- 
cated by an asterisk) the within instru- 
ment subcategories co/isist of the various 
scores yielded by the instrument. F >r all 
ot the other instruments and inventories 
(i,e., those developed InhoiKse) the within 
ihstrume!it subcategories consist ot data 
on each individual item or variable, as well 
as data oii a priori generated variables. (An 
a priori generated variable is a variable 
which has been arbitrarily generated From 
the combination of two or more individ- 
ual items prior to empirical analysis ot the 
•data yielded by the instrument). It should 
be noted that all processes including 
economic data in SDS are strictly mathe- 
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TABLE 2 . ■ 
MAJOR CATEGORIES OF SDS QUANTITATIVE DATA BY CODE NUMBER 

— f 

Input Data 1000 

Cognitive ' 1100 1300 

* lovva Tcbits of Educational Development ^1100 
' Dit'tcrential Aptitude Test 1200' 

Culture Fair. l.Q. Test - . 1300 
Noncognitivc 

* High School Personality Questionnaire 1400 

* Surveys of interpersonal and Personal Values 1500 

* Survey of Study Habits and Attitudes , 1600 
Student Master Identification Form 170p 
Student Master Identification Form-Update 1800 
The Massachusetts Pupil Inventories-MPI(A) ' 1900A/B 
General Demographic and Family Background Data-MALPi(B). 1910A/B 
Socioeconomic Background Data 1920A/B 
Student Relations with Parents * 1930A/B 
Parental Interest in'Student's Educaticm " 1940A/B 
Educational and Occupational Background 1950A/B 

Status and Aspirations 

Peer Relations and ("omparisons ' 1960A/B 

Interests and Activities 1970A/B 
Process Data on Teachers , * 2000 

The Massachusetts Occupational Education Teacher Survey (MOTES) ' ' 2100 

* The Teacher Program Questionnaire (TPQ) 2200 

* The Image of Vt)cational Education (IVE) 2300 
Th^' Planning Activities Sheet ' • " 2400 

^ The Purdue Teacher Opinionaire . 2500 

* Verbal Reasoning LQ. ' . 2600 
Process Data on Administrators 3000 

* The Image of Vocational Education 3100 
The Planning Activities Sheet 3200' 
The Massachusetts Administrator Inventory . 3300 

* Verbal Reasoning I.Q. ' • * 4000 

The Student Program Questionnaire 4100 

' The School Sentiment Index 4200 

Product Data 5000 

* Iowa Tests of Educational Qevelopment-Retests 5100 
(A)mpIetion/Nonc(>mpletion Data ' 5200 
Terminal objectives Data « 5300 

Impact Data \ * 6000 

Massachusetts Educational Impact Inventory 6100 

Massachusetts Job. Evaluation Form 6200 

Economic Data 7000 



^Commercial Instruments 



TABLE 3 

A SAMPLE FROM THE OPERATIONS INDEX WITH 
ILLrsTRATiVE EXAMPLES OF THE VARUUKS OPERATIONS 



I.IM) I cj^wal Operatiofts 

l.U) iDgicai C'vjmb illations 
1.11 And 

1.1 2 Or inclusive A - « 
l.iO Logical Relations 

1.21 Greater Than (GTl: 
1 1.22 LesbThan LTh 

, 1.23 Equal to ET^s: 
1.24 Nut Equal to NEi: 
U25 Not 
2.00 Mdthvmutiy di (^perAtUf>i^ 
2.10 Plu.s +i: 

2.20 Minuv :: 

2,3U Time> xi:« 



2.40 Divided by 



2.50 Exponentiatiun: 
2.60 Square: 
2.70 Square Ruot: 
3.t)0 Stiiti^tical Operations 

3.01 Count data items : 
3.1^2 Sum data items 

Operations 3.03, 3,04. and 3.05 

3.03 Sort data itemsir 

3.04 N tile Rank data items,: 

3.05 Scale by N tile- 

data item.s j: 
3.00- Mean daCa itcni.>t : 
3.07 Median data items)' 
3.0H Mode data items i: 
3.0'; Range data items : » »■ 
3-10 Variance: 
3, It Standard Deviation: 
4.00 \fea<ureii^j Relatiomhip 
4.10 Stepwise Multiple 
Regressiim R/; 



e.g.. all students who are both female and in office cduc.itiun prtigrarns 
e.g.. all students who are either female or in office education prugrams 

e.g.. all teachers \vith LQ.s grtfuter th^n 120, ur 
with LQ.s less than 120. ur .. 
with LQ.s equal to 120 

e.g.. all students with family incomes not cqujl tu $10,000 or mtire 
e.g., all students who are not in occupational cdutUtiun 

e^g.. number of students cnrullcd in Cosmetics programs p/H^ 
the number enrulled in Homemaking programs 
e.g.. the custs uf specific OE prugrams minus expenditures ' 
on equipment in those programs 

tu find the total number of hours a giy|» prugram meets each 
semester, the number of huurs thjit the prugram meets daily 
, ttmesA\\c number uf prugram sessiuns held that semester might 
\)C rdqucs'ted ^ "N^ 

It migh't'be requested that total prugrarn c.ust be divided by 
, nymber of students in the prtigram tu find the per pupil cust 
\i a given program , . : 

iViithcmaticai operations used primarily to perfurm 
stitistical operatiuns 



4.20 Multiple Rcgjcession: 



4.30 0 

4.40 0 0 mijx 

4.50 0 nux 

4.60 chi square 

4.70 cuntingency coefficient 



e.g.. a cuunt of the number of schutils offering a particular prugram 
This operation is uijcd to generate the basic summatiuns upon which 
most analysis uperations depend, e.g.. IX . i^X^, i^X j . . etc. 
consists of the scaling or urdcring uf data items 
it might request .tAiat students scores on the ITED ReadiiigTcst be 
sorted by sex , - 

A manager might w.>nt tu kntiwthe percentile rank of a given score 
on the Input Battery 

This operation consists of the icaling of items (e.g.. scores u^ tests) 
by their percentile rfink 

These operations all involve (meiisures of central tendency e.g.. 
mean, median or modal income of automotive mechanics graduates 

These operations all involve measures of dispersion e.g.. the range 
of scores on a test, the variance in test scores and the standard devia- 
tion associated^with a given mean test score 

This is tile operation used to select the independent variables which are 
to be included in a regrcssiun cquatiun. It consists oi the inscrtatiun of 
variables, one after another until the regression equation is satisfactory. 
Variables whose contribution tu predicting the dependent variable is 
nonsignificant are removed from the regressiun mudel. This process is 
continued until variables cannot enter the regression equation, and . 
variables cannut be removed from the equation 

'I'his opera^tion obt.uns ipfurmation about'a dependent variable in terms 
of several independent variables, e.g.. the rcUtionship between teacher ^ 
salary, teacher load, student attitude toward school, and teacher 
satisfaction * ^ 

Operations used primarily to determine relatiunships between variable^, 
one or more of which are nuncontinuous 
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maticaK witli the exception ot* btMiefit/ 
cost analyses. Refer to chapter 5 for a 
discussion of this. '(A more complete 
listitig of tlie variables available in the SDS 
Data Indices is provided in Table 2.) 

* 

Tlie Operations Index . \ 

The process" analysis, retrieval and/or 
display oi intormation stored in tlie 
MISOE data tiles frequently requires that 
certain operations be performed on 
selected variables listed in the CDS or SDS 
Data Chissificati'on Indices. The function 
o{ the Operations Index is to provide a 
coded listing oi tlie operations that mav 
be performed; thereby enabling the 
person who is interacting with the system 
to specify^ the 'code that identifies the 
particuhir^ operation he wishes to * have 
performed on tlie data. Several examples 
ot the use of the Operations Index will be 
provided at a latter point in this chapter. 
The Operation^ Index is divided into three 
sections "reHecting tlie tliree major cate- 
goriejr o^ ^)perations: 

1. Loj^icdl Operations: those o^crittions .that 
*- . can -be performed on either ^lonordered 
* data ; such as qualitative variables or 
orderid data sudh as quantitative variable^. 
The Operations included in tKis category 
are used primarily to classify or combine 
data units; they are particularly useful for 
. • specifying the particular group or thing 
upon which data is to be collected or 
distributed. 

2. Mathematical Operations: those operations 
that can be performed on ordered data 

, " tut., quantitative variables) only. 

3. Statistical Op^pitions: those operations 
, that entail statistical manipulations of ijie 

data. . . 
Each ot tlie major categories listed in the 
Pperations Index as well as many of the 
spej:ific 'operations within each category 
are detailed in Tabic 3, - 



The Oiitpiit Index 

It is ^uuicipated that MfSOE data will 
be available iit any of four modes; (1) on 
Inie and (2) off-lifie printing for' iuhouse c 
users; (3) 'the tennifial scope and (4) print 
out (hard' copy). There are also three 
types ot output forms or modes of output 
'that will be provided* [\ ) I'dbiiLir Out- 
puts, (2) Standard Statistical Analysis 
Outputs and (3) Graphic Outputs. The 
Output Index as illustrated in Table 4 
providers a coded listing of each of tlie 
-'outptrt modes and types available to the ' 
user. 



'TABLE 4 

- A SAMPLE OF THE OUTPUT INDEX 

1.000 Output Type 

1.100 Tabular Outputs 
, 1 .110 Comparison Tabic 

1 . 11 1 Unordered Listing 

1 .1 12 Simple Ordered Listing 

1.113 Ranked (Diagnostic) Listing 
1. 1 H Cross tabs 

1.115 Frequency Distributio^i 

1.116 Cumulative Frequency Distribution 

1.1 17 t^nrelation Matrices , ' ^■ 
1.200 Standard Statistical Analysis Outputs 
1,300 Graphic Outputs 

1.310 Discrete Subgroup 

1 .31 1 Bargraphs 
" ' 1.3J2 Pie-charts 

1 .3 1 3 Point-Scatter Plots 

1.320 Continuous Subgroup 

Linear Point-to-Point 

1.321 Least Square Fit 

1.322 Moving Average 
J 1.323 Ogive 

1.324 Lorenz Curve 

2.000 Output Mode 

2.10 At the Terminal 
2.20 At Remote Batch Printer (HiTSpeed) 

\ 
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r The second part of this chapter, as 
previously ineiitiofied, provides actual 
examples ol souk- ui the ways in which 
an educational manager might interact 
with the MLSOE computer system by. 
using tlie' three tvpes ot indices 
described earlier in this chapter. Th'e 
examples (UYered arc meant to provide 
the user with some feeling tor the 
flexibility tliaf" is permitted by the 



process of interacting with the system. 
These examples are by no means- ex- 
haustive in fact, they have been pur- 
posefully .simplified for demonstration 
purposes. It is our hope that these 
examp'les will serve, as stimuli to the 
imagination, thereby encouraging the 
reader to think of the many other pos- 
sibilitias provided by the MISOE man- 
• machine interactive process. 



PART II; A SUGGESTED PROCESS FOR INTERACTING 
/WITH THE MISOE COMPUTER SYSTEM 



As described earlier, the MISOE data 
files cOntain\an extensive array o.t intor- 
mation of enormous potential value to the 
educational manager. The second halt ot 
this chapter concerns the means by which 
an educational .manager may '^ain access 
to the information stored in the MISOE 
data files by using the various indices to 
the ct)mputer system described in Part I, 
It is important to understnad that in order 
4or the educational manager to interact 
intelligently with the MISOE computer 
sv.stem, it is necessary tor him to have a 
tlioroftgh familiarity with the various 
indices. This familiarity will be assumed 
throughout tjiis section. • 

A Process loi llctricvin^ hijoDnatiou 
p'ojfi tlw SystctJi: 

A systematic process has been sug^ 
gested for retrieving information trom the 
computer through the use ot these three 
indices. It is assumed that the educational 
manager has a particular cjuestloti in mind 
when attejnptlng to retrieve data trom the 
computer system. The first step in the 
information retrieval process in theretore: 
Step 1 = hxplicit statement of the questioti that 
initiated the probe in other words, 
_ what b the question that the informa- 

tion re t ri eve ~ Tr onT the computer 



sVstem is meant ^to answer? A simple 
example of an explicitly stated question 
that an educational manager might ask 
is: What is the average .starting salary of 
all occtlpational education completors 
who participated in cooperative study 
progrUtns as opposed to those who did 
not participate in cooperative study 
programs? 

Step 2 = Selection of th^ appropriate Data Index 
the manager must .select either the 
CDS Data Index or the SDS Data Index, 
depending upon whether the data that is 
sought pertains to the census or the 
sample population. The question stated 
above would require the use of the SDS 
Data Index because the information 
sought concerns all occupational educa- 
tion completoLs. 
After tlie first two steps have been 
completed, the manager is ready to 
begin using the three major indices 
(Data, Operations and . Output) to 
interact with the system and answer 
his question. * 

Step 3 = Re.<tatement of the probe question -- 
The probe ^question is restated by 
specifying the following * four faciors 
from the question: the target, the cri- 
terion, the output, and the classifica- 
tioJi, More than one of each can be 
specified. 
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1) The Target: the person or thin^.^^ 
he described by the data. The target 
tb specified by reterring to the app)ro- 
priate (CDS or SDS) Qualitative 

, Data Index and the Operations In- 
dtfx» -if the target is a function of any 
operation (i.e.. ^^girls^ and- boys = 
logical operator **plus''). There may 
be more than one target if more than 
one person or thing is to be describ- 
ed. For example, in the question 
specified in Step 1 there are two 
targets: 

a) Occupational education comple- 
tors who participated in c6ppera- 
tive study programs 

b) Occupational educa|ion comple- 
tors who did not"participatc in 
cooperative study program? 

Note that part of the specification of 
the target is the specification of any 
qualifiers that define the target. 

2) The Criterion: the data which de- 
scribes the 'Jarget. The criterion in 
the* question specified in Step 1 is 
the average starting income of each 
of the target group?. The criterion is 
specified by referring to the appro- 
priate Data Index (either Qualitative 
or Quantitative depending on the •' 
type of data- involved) and the Oper- 
ations Index to either stipulate the ' 
statistic in which the criterion is to 
appear (e.g.. the statistical operation 
**mean*' for average starting income)^ 
or, to create a more complicated 
criterion. A generated variable is an 
example of a more complicated cri- 
terion that can be requested by* 
having scores on. two or more indi- 
vidual data items summed by stipu- 
lating the mathematical operation 
^^plus'\ 

3) The Output: naming the type and 
mode of display of the retrieved 
criterion data. Output is specified by 



referring to theU)utput Index. For 
example, the manager who specified 
the question in Step 1 might request 
that the average starting income of 
th« target groups be displayed in a 
comparison table at the terminal. 
4) The Classification: naming the rows 
and/or columns (or, in the case^of 
the graphs, nattiing the*points along 
each of the ax€s) by which the 
criterion data on the target- is to be 
classified. {When the criterion data 
falls into one cell, classification is 
not applicable. For example, if the 
specified criterion was simply 
''average starting income of comple-. 
tors'\ classification would not be 
applicable). Classification of the cri- 
terion is specified by referring to the 
appropriate CDS or SDS Data Index 
or Indices {Qualitative, Quantitative 
or both) for the names of ihe rows 
and/or columns by which the cri- 
terion data is to be classified, and 
the Operations Index for any opera- 
tions required in order to classify the 
data in the desired manner. For 
example, the manager in our earlier 
example might request that the 
average .starting income of feach of 
his two target groups be classified as 
in the following manner: 



. ^ TABLES 
AVERAGE STARTING INCOME OF OE 
COMPLETORS WHO DID PARTICIPATE IN 
COOPERATIVE STUDY PROGRAMS VERSUS 
AVERAGE STARTING INCOME OF THOSE 
WHO DID NOT H 



Cooperative Study 
No C'ooperative Study 



X Starting Income 
$8,620 , 
^ $7,200 
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To. classify the criterion ctVta (that is, 
average starting inennie^ in tll^^s^lUUlI^^^ 
the manager vvouU have specitierTcTiat 
row 1 be cooperative study; row 2 be no 
cooperative ^>tuclv^ and that one column 
be hdxded x starting income. This is an 
• example o^ a very simple data classifica- 
tion; more ditVicult classitications will be 
presented later on. 

Let us now sum^ose that the manager, 
having U)oked at Table 5, -decides that he 
Wixuld like to reclassify his criterion data, 
average starting income, by school size as 
measured bv enrollment, becau.se he 
suspects that participation in a coopera- 
tive studv program has more influence 
upc)n the average starting wages ot C)E 
completfors fr{)m large schools than upon 
' the average starting wages ot C)E cbniple- 
tors «tM» small schools. He theretore 
requests iTcomparison table with the samv 
rows specified as in Table 5 (i.e,, coopera- 
tive study and no cooperative study) but 
with tjie following three colunui names to 
classify average starting wage dat.i* oi OE 
conipletors bv enrollment ot the school 
atleiided. hk» chooses tlui following three 
enrollment classificatjoilis: less than 1 
betwVen I, ()()() and lOOO, greater than 
2,000. (Note that thi Logical Operation 
*4ess t\idn\ ''equal / to" and ^'greater 

■ ' taiu/eo 

averacje starting !ncx)me of oe 
comhi.e'l-ors who participate in 

COOPERATIVE .STUDY PROGRAM VERSUS 
AVERACJE .STARTING INC:OME OF THOSE 
WHO' DlD/iOT BY SCHOOL SIZE 

School Si7e Enrollment) 

less than 2,000 
1,000 1,000 2000 or more 

Coop. Study $9,280 ^620 ^^t^L 
^ .^ No Coop. Study $7,500 ^ $7,543 S6,567 



thaix*' would have been speciiied in order 
to create this classification of the cri- 
terion.) An example of the data yielded 
by this classification of the criterion is 
presented in Table 6. The reclassification 
of the data presented in Table 5 into ^ 
Table '6 provides a very simple example ot 
one way in which an educational;manager 
might interact with the data in the MiSOE 
computer system through the . use of the 
system indices. Several more complicated 
examples of the man-machine interactive 
process are provided at a later point. 

Tiiere is an exception to the previously 
stated Vale that classification consists ot 
the naming of the rows and/or the 
columns bv which^ the criterion is to be 
clas.sified. In the case of regression anal- 
ysis, classification consists of the naming 
of the independent variables^ (i.e., those 
variables which are used to predict the 
criterion). The dependent variable (i.e., 
that variable whicli' is predicted) and the 
appropriate st-.vcistical oper^ition (i.e., step- 
wise or iniMtiplJsJ'egression) constitute the 
citterion in the case of regression analysis. 

Now that the reader has been*famil- 
iari'/ed with the process by which an 
educational manager may interact with 
the MISOE computer system through the 
use of the various indices, the remaining 
part of this chapter wijl be spent on 
providing several examples of this process. 
It i.s hoped that these examples, in^ addi- 
tion to providing you with a better 
understanding of the man-machine inter- 
active process, will also provide you with 
some feeling for the flexibility and range 
of the MtSOE system. You will notice 
that nothing has been sa^d thus far to 
indicate how the educational manager 
would use the information obtained by 
interacting with the system to better his 
planning and decision-making capabilities; 
that topic is fully discussed in Chapter 8, 
It should also be noted again that the 
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purpose of the discussion thus iar has 
been to provide the potential users of the 
MISOL system with, an overview the 
maiiMuachine iiiteraetive process; the 
actual technical details In* w^hich this 
interaction is to occur were purposely 
excluded from this chapter because they 
are still in the developmental stage. 

Sot}iL' l:\,n}iplc.< ol the lutviactivc Proccs.< 
tor Retrieval of lnjoi }fhitio}i fiom the 
MISOH Diitj t iles 

l-.XiiiJiple /. Suppose that an educa 
tit)iial manager wants information on the 
total expenditures in comprehensive 
schools tor all office education programs 
over the last five vears. Oiuc he has 
explicitly statC'd his question (Step 1 in 
the retrieval process), lie then decides 
(Step 2) whether the data that he seeks, 
expenditures tor office educati<)n pri)- 
grams in comprehensive s,chools, is C'DS 
data or SI)S data. He "decides that i, is 
CDS data because it concerns all office 
education programs, not only those in the 
sample, and there f (ire selects the C'DS 
Data Indices to refer tt) throughout the 
reiiiainder of the process. Step 3 in the 
retrieval process consists of the restating 
of the probe question by specifying the 
target, criterion, output and classification. 
F^e uses the CDS Data Indices, the Opera- 
tions Index and the ()utput Index*^to 
specify these: 

I'dr^ct: all ottice education programs in 
comprehensive schools specified 
from the CDS QuaUtative Data 
index] 

Criterion- total expenditures over the last 
tive years specified from the 
(!DS Quantitative Data Index- 
economic data) and the Opera- 
tions Index (since the mathe- 
matical operation ''plus'^ is re- 
quired to sum expenditures in 
years 1 through 5) 



Output : a comparison tahle (specified 
trom the Output Indox) 
C Lissifu dtion: iU)t appUi al^lc the criteriiUl data 
consists oi one luimheri 

The information retrieved would con 
sist of one number indicating the total 
expctulitures in comprefiensive sc^iools for 
alll)ffice education programs over the last 
Five years, e.g., S50(),()()a,()0(). 

liXiiiiiple J. Suppose that an educa- 
tii)nal manager is interest^'d in getting an 
idea of how nuieh it costs to train a 
student in automotive mechanics at the 
postsecondary level by looking at cur- 
rently occurring spending patterns. He 
asks the following question: How many 
schools w^ith automotive mechanics pro- 
grams at the postsecondary level have per 
pupil vearlv costs in the following ranges: 
less^tiian S6()(), $600 899, $900,1,199, 
Sn^nO;l,499, SK500 or njore. He decides 
that he would like the information to 
appear in a bargraph. With the CDS Data, 
Operations and Output Indices in hand, 
he is ready to restate his question as 
follows: 

Turret: schools with automotive mechan- 
ics programs at the postsecondary 
level (.specified from the (!DS 
Qualitative DaUi Index) 
CWitcrio)t: numher of school^ 'specify from 
Operations Index the , statistical 
operation ''count"). Specify that 
which is to he counted, i.e., the 
target schools from the (!I)S 
Qualitative Data Index. 
Output: Bargraph 
CLisdfkatioii: 1 ) the following per pupil yearly 
cost range points on the X axis: 
less tl)im S()00, $600-899, 
S900:.1,199, Sl,200 1 ,499, 
or more (note that this 
classification requires specifica- 
tion of the logical operations 
. **lcss than" and '"greater than"). 
2)^hc following numbers of 
schools on the Y axis: 2, 4, 6, 8» 
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10, 12. The inft)rmatioa that 
would be retrieved from the 
sybteiii us a result ot this prDbc is 
illustrated in Figure 2, 
From this graph, the ^educational 
manager might note that tlie modal per 
pupil yearly cost range tor automotive 
mechanics programs lit the post- 
secondarv level is between $900 and 



.$1,199. He niiglit then decide that he 
would also like to know the avcraire per 
pupil yearly cost of automotive mechanics 
programs at the post-secondary level in 
comprehensive and selt-contained schools 
.because he suspects that it is more costly 
in . the comprehensive schools. He would 
then begin the probe process over 
again: 



FIGURE 2 • " 
NUMBER OF SCHOOLS WITH AUT0MEC:HANK:S PROGRAMS AT THE POST- 
SEC:ONDARY LEVEL BY PER PUPIL YEARLY COSTS OF THOSE PROGRAMS 



Number 
of SchooU 



12-- 



10 



8-- 



lessthanS6()0 $6(H)>8^;^; S900-119^| S12004499 SI 500 or more 

Per Pupil Yearly Costs 



lixauiplc J. Suppose that an educa- 
tional manager is coii^^iilcriiii^ approvi}\^ 
}icw ocatpatioiuil proj^iranis and his main 
concern is the additional costs that would 
be incurred by creating these new pro- 
grams rather than by continuing to place 
students in already existing non- 
^pccupational education progranis. He 



decides that it would be u.seful to look at 
a comparison table showing the per pupil 
yeafrly cost of nonoccupational eduwition 
programs, occupational education pro- 
grams, and differences in costs between 
occupational and nonoccupational educa- 
ti(;n programs. Furthermore, he suspects 
that these cost differences may vary 
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considerably by region. He therefore 
would like to liave these cost figures 
displayed by educational region. His 
probe would be restated as follows: 

Target: occupational education programs; 

nonoccupational education pro- 
grams. (Anothcr^ example of a 
multiple target-specified from the 
CDS Qualitative Data Index). 
Criterion: per pupil yearly costs and cost 
differences specified from CDS 
Quantitative Data Index and the 
Operations Index * 
Output: Ci)mparison table 
CLisf:ijication: (IjRowsl per ' pupil yearly 

cost of occupa- 
tional education 
(specified from the 
CDS* Quantitative 
Data Index and the 
Operations Index) 

2 per pupil yearly 
cost of nonoccupa- 
tional education 
(specified as above) 

3 per pupil yearly 
cost differences be- 
tween occupational 
education and non- 

, occupational educa- 

tion. ^^^k)te that 
row 3 is created by 
specifying the 
mathematical oper- 
ation **minus" and 
subtracting one row 
from another), 
'2) 6 colums one for each 
educational region 
Table 7 shows the information that 
would be generated by this probe. The 
manager might note that the difference in 
per pupil yearly costs of occupational and 
nonoccupational ed^ication does vary con- 
siderably from region to region. He might , 
Iiypotiiesize that these differences are a 



function of the different types of pro- 
grams offered in the different regit)ns. 
After looking at the tabk\ he might tiien 
decide that lie wants to know'whicli 
programs are offered in that region in 
vv^liich the cost differences were tiie 
greatest (Region 2), and the costs asso- 
ciated with each of the programs. This 
probe would be stated as follows: 

Target: occupational education programs 
in Region 2 

, Criterion: (1 ) OE programs offered in 
Region 2 

(2) per pupil'yettrly costs of each 
program offered 

(3) 5 year average earnings of 
graduates of those programs. 
(This is an example of a multi- 
ple criterion specified from 
the Data and Operations 
Indices). ' 

Output: comparison table 
Classification: Rows 1 per pupil yearly cost of 
occupational education 
programs 
2 average 5 year earnings 
of graduates' of those 
programs 
Columns — one column for each 
occupational education 
program ' offered in 
Region 2. 

The information yielded by this probe is 
shown in Table 8. After seeing this data, 
the manager might decide to initiate a 
benefit-cost analysis, or he might want to 
see even finOr breakdowns of the data. 

li.waiiple ^4. A particular educational 
manager is considering trying to improve 
the attitude that students enrolled in 
occupational education within mM school 
district have toward a specSA: pro- 
gram in which they are enrolled. He 
suspects that studentS/who have a more 
favorable attitude toward their program 
will be more satisfied with the jobs tiiat 
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TABL^7 iy^^^ 

c:()MPARisoN OF (x:cuPATiON>^i. cx)st)by pupil^y region 



Region 
1 



Region Region Region Regi^U» Region 



1. Annual' 
Per Pupil 
Cost ofOE 

2. Annual 
Per Pupil 
Cost of NOE 

3. Annual 
Difference 



$1,872 $2,421 $1,924 $1J61 • $1,772 • $1,831 
$1,421 $1,581 $1,221 $1,201 $1,126 $1,201 
$ 451 $ 840 $ 723' $ 560 $ 646 $ 630 



, TABLE 3 

REGION 2 ECONOMIC DATA BREAKOUT 
Pc r P upil Yearly Costir of Occupational Education Offered in Region Two 

Auto Mechanics ' Electronics Woodworking Child Care 

$ 1,762 



$ 2,716 
$50,000 



Per Pupil 
Yearly Costs 
Average 5 Year 
Earnings ot 
Graduate 

they eventual^^jfceive than students with 
less Favorable attitudes. He notices, aher 
browsing through the SDS Quantitative 
Data Index,, that student attitude toward 
a program is a variable measured by the 
Student Program Questionnaire; lie also 
notices that job satisfaction is assessed by 
items on the impact, instrument. The 
question he asks is: Does student attitude 
toward an occupational education ' 
program have an independent effect on 
job. satisfaction, controlling other vari- 
ables sucli as ability? This question might 
be restated for th^ probe as follows: 

Target: all SDS(2) students followed up 
in impact space for 3 years 
Criterion: »(.l)job satisfaction score yielded 
by the impact instrument 
{could be a Cxen Var) the 
dependent variable 



$ 2,618 
$60,000 



$ 1,923 
$50,000 



/$32,000 



(2) the Statistical Operation, re- 
gression 

Output: Standard statistical analysis out- 
put the regression coefficient 
CLissificLition: scores on the Student Program 
Questionnaire - (the dependent 
variable) 

The regression coefficient and summary 
table yielded by this probe might con- 
vince the manager that he should indeed 
try to improve the attitude of students 
toward their programs it he wants to 
increase the likelihood that they will be 
satisfied with the jobs that they ,even- 
tually receive, in which case he might try 
to manipulate the educational process so 
as to improve attitudes (i.e., by offering 
more courses) or the data might convince 
him that he should look at the relation- 
ship between some other process variable 
or variables and job satisfaction because 
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student attitude and job satisfaction were 
iu)t hmiid to be highly related. This 
example was provided in order to demon- 
strate a simple case ot regression analysis 
and the unique speciHcation of criterion 
and classification h)r regression analysis as 
mentioned earlier. An actual summary 
table that would be yielded by such an 
analysis has, howevw, not been generated 
' tor the example. 

From these tew examples, it is hoped 



that the reader will have bee^i able to gain 
an appreciation o( the enormous 
flexibility that an educational manager 
would have in interacting with the 
MISOE computer sysfem. The number ot 
probes and consequently the ditterent 
types ot information that a manager 
could" request by using any combination 
otc the three indices to the system is 
virtually unlimited. The only major 
restraint upon the user is that the data in 
whicluhe is interested exists within the 
system. 
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CHAPTER 8 ' 
PLANNING FOR OCCUPATIONAL EDUCATION WITH MISOE 



William (}. (.'onioy, ]i\ 



TIk* singlo purpose t)t this chapter is 
pr(A'idc* tlu* rmiUt with a sinudatfd o\ 
pcriciKt in statcvvitU* planning tor occupa 
tinnal t\iiu\ition with an intrractivf com 
piitcr svstcui. So that this presentation 
will not he masked by a morass ot 
technical and - organi/atioiial tangle, 
several simplifying assiiniptions are stip 
ulattuf tt) set a representative hut uii 
cluttered stage for describing a man 
ccmiputer planning dialogue. 

As'siimptiini -1. c\du\p\c planning 

experience* is tncu^ed npun a divisicui tnr the 
management t)t ocfnp.ition.il educ.ition 
DOE; within a state department of edu 
Cation, 

' \^\umpui0}i « J, The results ot the pl.mning 
function by lX)li result in ptilicy recom 
mentations to a (!hief State Schttol OHlcer. It 
is assumed that the Chief State School Officer 
synthesizes policies from spe rial interest divi 
sions within the Department of Education and 
takes appropri.ite a<"ti»)n with eithei< the St.ite 
Schcu)! Bo.ird. the Legislature^ or both, to 
implement policy. 



\ssuttipytf'on -J. Pohi-y recom men il.it ions 
oi the Division of C^cupation.d Educ.ition 
must reflect concern for the r^.uionship 
between the occupat*ion.d and human develop 
men I of students, in light of a comprehensive 
r.uige of go.ds for public educ.ition. These 
go.ils .ue typically designed to retlect the 
v.dues ot the larger society and its expet t.ition 
of public educ.ition, ' 

Assumption Policy ^ ct)mmend.itions 
must include a description oi' the expected 
imp.iet of the results ut specific policy on 
societv in the future. Polity reconmiendatit)ns 
which do !iot connect educatioff with the 
society it is- designed to serve are not per- 
mitted. • • 

* Assumption iO. Policy rectmimendations 
must consider the cost ot the poHey recom 
mended, .is well .is the v.ilue to society. ot'flie 
heneHts received. The quantitic.ition ot poHcy 
recommendations in terms ot dollars is 
assumed essenti.iL .is resources for public 
education are limited and cDmpetivivcly 
alKac.ited as'.i result of the perceived contri- 
bution of education to* societal go.iLs in 
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comparison to other worthy activities like 
health care for the aged, national defense^ 
family assistance, prison refornr. environ- 
mental protection, highways, etc.. Accord- 
ingly, rational decision making is described as 
the selection of an alternative process or 
'program designed to accomplish a specified 
goal at the -minimum cost. It follows that 
planning describes the process of developing 
(creating) alternatives to accomplish explicit 
objectives, a^id the role of an interactive 
computer system is to connect man the 
planhcr'^and decider with information and 
operations which help estimate the state of 
the world in relationship to specific go^ls and 
the likfely consequences of alternative plans. 

Ass^nption t^6. The example planning 
experience assumes a twenty^five year fully 
operational MISOE as described in this publi- 
cation. The year of the simulated planning 
experience is 19?6. * 

Assumption 4t7. Although local education 
agencies, special itucrest groups and advisory 
councils are not included in this example, it is 
."^ assumed that their influence has been ac- 
counted^or_by DOE. 

fThe Policy Making Process 

, Policy recontniendations are defiiied as 
statements which clearly describe specific 
action to be taken'to accon^plish specified 
goals. A policy statement includes both 
the action to be taken and the goals to be 
accomplished. Goals for educational 
policy include a description of both the' 
short terms capabilities and skills to be 
learned by studeAts and the expected 
irfipact of these students on society in 
future time. / 

The action section of a policy recbm- 
• mendation stipulators a change in some ^ 
part of the educational system which is 
designed to bring about the aocompHsh- 
ment of specified goals. Researchers fre- 
quently call changeable components vari- 
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ables (things which can be varied). Tlvese 
variables not only include jjU components 
of the educ'atianal process, from teachers 
to textbc^ks but the range of students to 
be served. The research community has 
somehow conie to describe the change 
. process as manipulation of variables. Fre- 
quently, the so-called humanist manager 
thinks of this description as dehumanizing 
jargon, but to the social scientist it merely 
describes the action part of a policy 
statement in an accurate way. 

Even a cursory cori&ideration of the 
'policy getting process cannot avoid the 
concept of constraints. A constraint is 
simply an immovable given, something, 
that cannot be changed or manipulated by 
management. Usually, the higher one goes 
in an organization, the fewer constraints 
that apply to a policy recornmendation. 
For example, a Constraint to planning 
from a superintendents's perspective is a 
requirement that all youth attend public 
education for a prescribed number of days 
each year until they reach an established 
Vge. Since this example assumed policy 
recommendations are niade*f9r the legisla- 
ture by an administrative branch of state 
government, no constraints limit the range, 
of alternatives available to DOE in prob- 
ing policy alternatives. 

['onnai for Simulated Man - Computer 
Plamiing Ex^rience 

The simulated planning e5tperience 
describes the development of 'a single 
policy recommendation by DOE. In 
reality, this experience would be repeated 
for each policy recommendation, and 
finally the relationships' among policy 
recommendatins would be ^exjimined 
before subniission to a chief state school ■ 
officer. It is assumed that relationships^ 
among policies from special interest 
management divisions of the total depart- 
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ment of educafion would.be examined by 
ftie Chief State School Officer. 

The development of a policy recom- 
mendation results fr6m a series of in- 
quiries or hypotheses initiated by manage- 
ment,' a dialogue between management 
and' computer to estimate current values 
of policy related variables or relationships 
among these elem.ents, and finally an 
analysis of the results of this information. 
Each man-computer dialogue results in an 
information statement by the computer 
to- the manager. Each inquiry, dialogue, 
and analysis experi.ence is described as a 
probe. A twenty-five probe example is 
offered to describe how MISOfi is de- 



signed to* siipport the development of 
pdlicy recommendations for occupational 
education at th^ state-level. 

The call system described in Chapter 7 
constitutes the basis for the man- 
computer dialogue. To avoid interfering 
with the logical flow this example, call 
detail tequired tCK. ^escribe <^ach man- 
computer interaction will be simplified in 
conversational language. 

* — 

Probe #1 ' 

*^ . 

4 

0 

Management Inquiry. DOE begins 
policy development by speculating about 
the differential impact of students of 



TABLE 1 

COMPUTER INFORMATION STATEMENT 
Target: Males, Completors^ Dropouts, Cohort 1, 
* SDS 1 & 2, All Strata, Secondary, Criteria: M. SD. 





Secondary Co 


mpletors 




Dropouts 


Sec 
& 




% • 




OE 


noe' 


OE 


NQE 


4 Yr. 




OE 


NOE 


No Cont 


No Cont 


No Cont 


No Cont 


CoU 




1 


2 


3 


4 


5 -.■ 


6 

i- 


^ 7 


1. Ave 


$12,600. 


$12,823. 


$11,573. 


$ 8,171. 


.$10,941. 


$ 5,531. 


$13,172. 


Income 


1,120 ^ 


2,764 


736 


681 


431^ 


736 


4,732 


2. Spouses 


$ 6,-230. 


$ 6,173. 


$ 6,010. 


$ 4,271., 


$ 4,312. 


$ 4,112. 


$ 6,217. 


Ave Income 


281 


270 


173^ 


371 


297 


297 


321 


3. Family 


$140^ 


$13,722. 


$13,872.. 


$10,731. 


$12,312. 


$ 8,103. 


$15,731. 


Ave Income 


873 


2,581 


761 


531 


1,073 


. 431 


271 


4'. Net 


$22,731. , 


$21,473. 


$20,764., 


$10,731. 


$14,731. 


$ 4,172. 


$28,743. 


Worth 


3,241 


2,973 


3,101 


1,073 


431 


211 


2,763 


5. Ave Mo 


1.2 


2.2 


1.3 


' 3.7 




4.7 


1.0 


Unemp 


.3 


' 1.1 


.3 


.6 


1.1 


2.1 


1.1 


6. Ave No 


4.1 


4.2 


4.1 




5.1 


6.2 


' ^ ' 3.2 


Depend 


.4 ^ 


.6 


.2 


1.3 




2.8 


1.4 


7. Unemp 


$ 1^812. 


$ 1,769. 


$ 1,873. 


$ 2,731. 


$ 2,173. 


$ 3,219. 


$ 741. 


Benefits 


96.2 • 


345.2 


81.2 


142.3 


273.2, 


213.1 


87.2 


8. Welfare 


$ 456. 


$ 531. 


$ 572. 


$ 2,172. 


$ 932. 


$ 3,991.. 


S 351. 


Benefits 


14.1 


25.2 


35.2 


278.6 


41.2 


432.7 


11.6 



Note: All Dollar Values Adjusted to 1976 Dollars. 



Mr 



98 



94 



dccupational and nonoccupational educa- 
tion on society over ten years. This seems 
a reasonable pl;ice to begin, as occupa- 
tional education^ is usually an extra cost 
program, compared to nonoccupational 
education. DOE decides to* estimate the 
differences, if any, of eight economic 
variables for secondary students who 
eitlyer completed or dr6pped out from 
occupational (OE) or nonoccupational 
(NOE) education" and either continued or 
did no^ conthiue their cduciation beyond 
the secondary school. Tht^ economic vari- 
ables include: income, spouse's income, 
family income, net worth, months un- 
employed, number x)f dependents, un- 
employment and Welfare benefits re- 
ceived. The rcxjueSt is for information 
averaged by student group for fifteen 
years since completing secondary educa- 
tion. The request is made for all students 
in the sample data systems for ^11 sample 
i^trata. 5,^ , 

Mayia^enient Analysis. An inspection of 
the Computer Information System reveals 

'that secondary level OE and NOE com- 
pleters do not differ greatly oh these 

'economic variables^ with the exception ot 

^OE completqrs who do not continue 
education. They make several thousand , 
dollars less per year, on the average, as do 
their spouses; their family income is 

, Several thousand dollars less^ their net 
worth is about one half- of the other 

* groups, they are unemployed longer; and 
collect more unemployment and welfare 
benefits. All secondary completors (cl. 7) 
who completed four years of college 
collected less unemployment and welfare 
benefits than OE completers who did not 
continue education^ and are slightly better 
off, on each economic measure. Surpris- 
ingly, OE dropouts do not seem to fall 
that far behind the average scores for all 
OE and NOE completors on this array of 
economic, variables, although they are 



clearly not as successful in terms of these 
measures as program completors. This is 
particularly true of net worth. 

NOE dropouts clearly constitute a 
disaster group in terms of these indices. 
.When compared to OE completors w-ho 
did not continue educdJtion, tliey earn less 
than one half the income, have achieved 
only a 20 per cent net worth position, are 
unemployed three times as long, collect 
twice as many .i^nemployinenj benefits 
and ilbout seven times as much welfare. 



Proh 



ALviagcniait hiquiry. DOE next 
decides to determine if these differences 
exist for females as well as males;- i.e., 
secondary completofs and dropouts of OE 
and NOE programs who either continued 
or did not continue education. The 
inquiry is made for the same economic 
variables. 

Managcrnoit A}ialysi's. The Computer 
Information Statemeiif clearly indicates 
that this' distinction is of the same relative 
magnitude for males and femaleS^. jf^ 
reasonable conclusion from these first 
probes would be that there seems to be a 
systematic difference between NOE 
students who dropped, out of school and 
,did not continue theijs education and the 
other groups, and that these students: are 
systematically worscj off on all measures. 

Probe #3 < 

Manaj^cmoit Inquiry, The next concern 
of DOE is to determine if this difference' 
extends to variables 'beyond ba^^ 
economic indices. From items of instru- 
ments of tlui data indices, DOE aggregates 
(a priori) several variables on which to 
com{)are the groups, and they are: 



V 



1. Ave 

Income 

2. Spouses 
Ave Income , 

3. Family 
Ave Income 




7. Unemp 
Benefits 

8. Welfare 
Benefits 



. TABLE 2 
COMPUTER INFORMATION STATEMENT 
Target: Males, Completors &: Dropouts, Cohort 1, 
SDS 1 &: 2, All Stbta, Secondary, Criteria: M. SD. 



Secondary Completors 



Dropouts 



OE 
1 



NOE 



OE 
No Cont 
3 



NOE 
No.Cont 
4 



OE 
No Cont 

. .5 



NOE 
No Cont 
6 



Sec 

& 

4 Yr. 

, Coll 
7 



S 7,431. 


$ 


5,631. 


$ 6,721. 


$ 5,012. 


$ 5,971. 


$ 3,821. 


$ 8,149. 


^ 600 ^ 




843 


724 
ft 


" CO 1 




S1 1 

O 1 J. 




121 


$12,431. 


$12,621. 


$1^,973. ' 


$ 8,012. 


$ 8,312. 


'% 5,213. 


;H6,118. 


432 




822 


921 


412 


511 


712 




512 * 


114,473. 


$13,011. 


$13,001. 


$10,120. 


$10,011. 


$ 7,246. 


$18,941. 


415 




941 


412 


591 


431 


713 ^ 




912 


$22,174. 


$21,596. 


$20,001. 


$16,141. 


$17,143. 


$10,931. 


$21,936. 


1,025 




^ 441 


512 


891 


*^91 


1,212 




642 


2.3 




3.1 


2.6 


3.7 


2.9 


4.1 




2.1 


1.3 




1.7 


1.7 


. 1,8 


2.1 


• 2.0 




1.3 


4.0 




4.3 


4.2 


4.9 


^4.4 


5.4 




3.8 


2.1 




2.1 


2.0 


2.4 


2.4 


1.9 




.3 


$ 683. 


$ 


978. 


$ 691. 


1 x/'t2. 


$ 742. 


$ 2,172. 


$ 


431. 


72 




142 


92 


138 


119 


216^ 




^2 


$ 500/ 


$ 


643. 


$ 542. 


$ 842. 


$' 625. 


$ 2,132. 


$ 


301. 


70 




r 182 


6l' 


146 


41 


412 




121* 



Note: All Dollar Values Xdjusted to 1976 Dollars. 



economic productivity/ , community 
services, verting behaviar, job satisfaction 
and participation in sports* DO© assumes 
that community service, voting behavior 
and participation in sports represent a 
range of nonoccupationally related 
behavior which is associated wi4:h the 
general goals of total secondary, educa- 
tion. This inquiry is made for the same 
secondary group, i.e., secondary 
completors and dropouts who either 
continued or did not continue education 
beyond the secondary leyel. 

Manuf^ement Analysis. The data reveal 
little differences between OE and NOE 



completors, with OE program completors 
slightly more productive, satisfied with 
their Jobs and involved in comnxunity 
service tiban their NOE counterparts. OE 
completors who did not continue edu- 
cation enjoy"' an advantage to NOE 
completors who., did not continue 
education. OE dropouts and OE 
completors do not seem very different, 
except in terms of ]oh satisfaction, while 
,NOE dropouts are at the same relative 
disadvantage on this>range of variables as 
they . are on the economic indices. 



Secondary compietors who complete 
college are not. much different than OE 
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TABLE 

(X )MPl rvEK INFORMATION STATEMENT 
Target; Males t<K Females, ( A)niplet4)ri. Dropiuits, Cohort 1, 
SDS 1 a 2. All\Strata:Seconaai v\ Cntenn: M. SI). 





• 




Secondary C!ompletors 


Dropouts • 


Sec 








OF 


NOE 


OE ' 


NOE 


A Vr 

*T I r. 




OE 


NOE 


No Cont 


No Gont 


No (?ont 


No (\)nt 


Ct)ll 




1 


') 


3 


4 


5 


() 


7 




7 


b.l 


7,0 


4.9 


0.8 


3.7 • 


7 


'(Jen Va| 1 


1.1 


3.1 


-■I 


3.4 


2.1 
f 


1.8 




•2. ( umm Serv 


8.1 


(>.l 


7 0 


VI. M 


7 f\ 


^' d 1 

. T". 1 


7.*1 


Gen Var 21 


.1.2 


2.3 




0 fx 






2.8 


3. Vot.Uehav 


5.1 


5.0 


4.9 


4,2 


4,9 


3.1 


5,0 ' 


(tCfi Var 3 f 


1.1 


1.3 


1.2 


1^ 1.8 


1.6- 


1.2 


. i.V • 


4. Job Statu 


HA 


().l 


7.8 


5,1 


5.9 


3.1. 


8.0 


On Var 4) 


2.1 


- 3.1 


'2.0 


,2,4 


2.8 


4.r 


4.1 


5. Part Spor 


4.2 


4.2 


' .4.0 


3.8 


4.1 


2.1 


5.2 


Gen Var 5 ) 


3.1 


3.8 


3.1 


3.0 


3.1 


2.8 


^ 3.2 






In&t 




Itenih 










Gen. Var. (1) ( ) 


? ) 


i ) ) 










Gen. Var, 


(2) ( ) 


( ) 


( •) ( ) 






• * 


• 


Gen. Var. f3j ( ). 


( ) 


{') ( ) 










CJcn. Var^ (4)^ *( ) 




( ) ( )\ 




■ \ 






(Jen. V.ir. 


(5j - ( ) 


i ) 


( ) ( ) 









coin pie tors who do not cont'inue educa- 
tion, as do.scribed by tins inforniution. * 



now ni 



Mdna^cttictit hiqtiiry. IX)E 
qnires of the extent or what is beginning 
to appear to be a probable social problem 
upon which occupational education might 
exert a favorable impact, the NOE drop- 
out. Previous question.s liave been made of 
th* sample (lata systems, \yith weighted 
(to the population) response.s. In this case, 
however, management is interested in a 
description of the total population of 
dropouts, and discovers from the CDS 
Data Index that such information is avail- 



able. As a way of assessing the relative* size 
of the dropout problem, DOE frames its 
hiquiry in terms of OE and NOE males 
and females, classified by school and 
geographical .settings. It* requests that this 
informati(m be displayed in relationship 
to enrollments, and asks t(«#Wverages over 
the last ten years. / 
. Maiuij^cincfit vUluI^s, This ('oitipHter 
Information StauMnent indicates that ^he 
problem seems to have considerable scope 
and is^ concentrated on NOE males, who 
account for 82 per cent of the annual 
secoadary dropout total of over 35,000 
students (10 per cent of the secondary 
enrollment). Seventy-six per cent of these 
dropouts are located in cities of 75;000 or 
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TABLE 4 

' * COMPUTER INFORMATION STATEMENT 
Target: Annual Dropouts &'Annual State Enrollment, 
CDS. Male & Femde, Secondary 
Criteria: Count, % of Total Dropouts 



Annual Dropouts from Programs 

NOE 



OE 



Male 
1 



Female 
2 



Male 
3 



Female 
4^ 



Total 
Annual 
Sec'dry 
School 
Dropouts 
5 



Total 
State 
Enroll 
' 6" 





U Statewide 


' 2,534 

7% 


1,859 
5% • 


. 28,682 
82% 


2,050 

6% 


35,125 


-3S1,250 

t' 




2. Cities of 7^ , 
' Thousand More 


712 
, 2% 


532 

2% 


10,621 
53% 


860 

2% 


20,825 
59% 


• 178,126 




3, Cities & Towns 
Between 10 & 75 


U364 
4% 


'975 
3% 


8,312 
23% 


741 

2% 


' 11,392 
. '*^2%' 


112,914 




Thousand 
















4. Regional , 
Schools 


408 
V!o 


214 
.5% 


1,328 

4% 


300. 
1% 


2,250 
6.5% 


38,121 




5. Cities & Towns 
of Less Than 
10 Thousand 


50 
.5% 

» 


38 
.5% 


421 
1% 


149 
.5% 


658 
• 2.5% 


22,089 



over or in cities or towns of between 
10,000 and 75,000. According to this 
information, public education produces 
over one quarter of a million NOE drop^ 
outs every 10 years, 82 per cent of whom 
are males' from NOE programs. and who 
*seem to be systematically less than equal^ 
to OE conipletors and dropouts on a' 
number of economic and social indicators. 

Probe #5 

'\ 

Management Inqtiity. This is simply a 
^ technical request to cross tab the dropout 
•description more efficiently than in Probe 
4 ^or the same population, annual number 
of dropouts over the last ten years, 
arrayed by sex aCnd program type. 
iXIanagement Analysis. None. 



Probe #6 

Management Inquiry, The nexj: inquiry ^ 
C)f V>p^ is designed to discover if there are 
systematic differences between average 
educational costs to society for groups of 
studenifi that seem to be systematically 
different in terms of their economic and 
social welfare.. This inquiry is made for a 
cohort of /-students in -the Sample Data 
Systems and- specifically asks about the 
average expenditure per student for NOE 
and OE students who complete or drop 4. 

"•out of secondary programs and do not 
continue education. The request also 
inquires about the average annual private, 
economic benefits (salary from job) and 
social- benefits (total taxes paid), averaged 

- over students within groups. Both social 

\ 
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TABLE 5 

C:OMPUTER INFORMATION STATEMENT * 
Target: CDS, MaleA Female. Secondary, Dropouts, 
C:riteria: Count & % of Total Dropouts 







Annual 


Annual 


Annual 






Male 


Female 


Total 






DropQuts^ 

Ik 


Dropouts 


Dropouts 






(1) 


(2) 






(1 ) Annual OE Dropouts 


2,534 




4,393 






7% 


5% 


12% 




(2)*Annual NOE Dropouts 


28,682 


2,050 


30,732 


• 




* 82% 




88% 




(3) Annual Total Dropouts 


31,216 ^ . 


3,909 


35,125 






* 89% ' 


11% 





TABLE 6 

COMPUTER INFORMATION STATEMENT 
Target: Males, SDS 1 & 2, Cohort 1, All Strata, Secondary 
Criteria: (1) Average Private and Social Benefits Over 15 . Years 
(2) Per CompletofCost ' 



Pe» Pupil 
Program 
iipsts 



1. All NOE Dropouts $3,Q00. 
No Cont Education. * SD 800 

2. All NOE Sec Completors ^ S5,100. 
No* Cont Education SD 310 

3. All OE Sec Dt'opouts * $5,500. 
No Cont Education SD 625 - 

4. All OE Sec Completors $6,521. 
No Cont Education SD 35d 



Annual Per 


Pupil Benefits (2) 


Gen Varj[l) 




Gen Var (2) 


PrivUte 


St 


Social 


$ 5,531. 




$ 897. 


SD 736 




SD 147. 


S 8,171. 




$1,797. ^ 


SD 631 




SD 145 


$10,941. 




$2,335. 


SD431 




SD 107 


$11,573. 




' $2,893. 


SD 736 




SD 184 



(1) Completor Cost = Total Cost / All Completors 

(2) All Dojlars Values Adjusted to 1976 Dollars 



Gen Var (1) 
Gen Var (2) 



Inst 
( ) 
( ) 



Items 

(),()() 
()().() 



ERIC 
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and private benefits are Ck»n Vars, deter 
mined from specifying instrunients and 
items from the SUS Data Index. Social 
and private benet'ijts are specitied at dollar 
values adjusted to the 1976 d^jHar. 

MiUUiiicment Atudysis, It is evident 
from this dialogue between man and 
computer that, on the average, the pubHc^ 
cost k)r NOE dropouts is about one halt 
of that for OE completor.s, but that the 
^social benefits (in terms ot taxes) .is 
almoxSt three thne.s as large. It is interest- 
ing to note thf relative ditterences 
between .i)E dropouts and completors.. 
The cost is not much different, wliicli 
might suggest that students don't* drop 
out early in programs, and the average 
benefits over fifteen years are also not 
very different. This could' be a' case ot 
educational overkill, but is tangential to 
the major thrust of the current probe (but 
could be returned to by DOE as the basis 
for a second probe series). 



Ptohc ^7 . 
> 

MdHiiifcnioit Inquiry, Tlie next inquiry 
by DOE management is designed to deter- 
mine differential' relaticmsliips between 
costs and benefits for all NOE dropouts 
and all OE completors. This information 
is requested for the same cohort^ auditor 
all strata in the sampling design^ and, ot 
course, for males only. Specifically the 
request is to determine the realtiye cC)sts 
c(*nipared to fifteen years social benetits 
of all OE secondary completors and all 
NOE dropouts. Also requested is a disph^V 
of the extra costs of all dropouts had they 
all been transferred to become OE com- 
pletors, as well as the extra social benefiti> 
that would have been achieved if NOE 
dropouts had maintained about the kune 
level of social payback to government 4S 
had the average OE completor. ft should 
-be noted that' costs and benefits are 
prc^sentt'd ' in constant 1976 dollars 



Costs 

15'YrSoci;ir 
Benefits 

Cost/Benefit 
Ratio 



TABLE 7 - ' ^ 

COMPUTER INFORMATION STATEMENT ' . 
Target: NOE Dropouts, OE Completors,^SDS \ &c 2, 

Cohort 1, All Strata, Secondary 
Criteria: (I) Costs & 15 Yr Benefits for Student Groups 
, (2) Extra Costs & Benefits Had NOE Dropouts 

Been OE Completors 



NOE .Dropouts 
$ 86,046,000. 
5385,916,310. 

1/4 



OE Ct>rapIetors 
$ 187,035,322. 
Sl,244,655,390. 



1/7 



Extra Costs & 
Benefits if NOE 
Dropouts Were OE 
(Completors 

$100,909,322. 

$858,739,080. 



J. 



For simplicity, this probe series is limited to 1 NOE cohort over all strata. 



(resultiiijg; from ccprtCniuc assumptions and 
data treatiruaTflTwitli a result of providing 
a basjiHx^r cost and \>enefit comparisons. 
^^^^dihii^emcHt . l;h//vA7.s*. Tlie computer 
statement requires little explanation. For 
every dollar invested in NOE dropouts, 
tour tire returned over a period of fifteen, 
years, while seven are returned to society 
for every dollar invested in C)E comple- 
tors. Jt would cost society an iixtra 
S 100,989,322 to have j^t^rcd NOE 
dropouts as -OE cuurptetors, but they 
could expect .additional benefits over fif- 
teen yy^r^i to <^ceed $850,000,000. Ob- 
\;unlsly, tliese datii are based on a variety 
of shaky assumptions. For example, it is 
not all likely that HOE dropouts could be 



expected to sut.-ceed'^at the same rate as 
OE completors, or for the saiiie cost. 
Further, n they did, it is not certain that 
they would generate the sama level of 
social benefits as. current OE ^completors, 
on the average. , .1 

Prohc 

» 

Mami^cffwjit Ifiqtttry. In light of these 
sweeping assumptions^ required to make 
sense of the data and which render it not 
very useful for anything but an assessment 
of differential impact, much more specific 
information is required by mahagenieut 
for the purpose of developing a recom- 
mendation to do something about a 



TABLE 8 

COMPUTER INFORMATION STATEMENT, 
Stepwise Multiple C-orrelation 
Independent Variable: Input Battery 
Dependent Variable: NOE Dropouts / OE Completors 

Target: Males» OE Completors & NOE Dropout.s, Cohort 1, 
SDS 1 & 2* Ail Str^Ita, Secondary 
Criteria: M., SD., % of Contribution of IndependvMU Variables 
to Criterion (NOE Dropouts) » 



NOE Dropouts 
OE Conft'pletors 



ITED 

Reading 
Total 

33.3 
SD 7.1 

42.3 
SD 4.1 



R ^ .78 
MP! 

Family Support 
For Education 

2.4 
SD 1.2 

7.2 
SD2.1 



MPI 
r^ontrol ( 



if 



E.ivironment 

6.6 
SD 1.1 

9.3 
SD 1.3 



. HSPQ 

Emotional 
Stability 

5.0 
SD 1.1 

8.2 
SD 2.1 



Independent * r 
% Contribution 
of Variables to 
Variance of NOE 
Dropouts 



ITED 

Reading 
Total 

'.21% 



MPI 

Family Support 
For Education 

17% 



MPI ' 

Control of 
Environment 

12% 



HSPQ 

Emotional 
-Stability 



JO,') 



problem other tlian merely recognize 
its nlost obvious cliaracteristics.^ ' 

IX)E now seeks of tlie computer sy>^ 
tern information wliicli describl's tlie basis 
upon wliicli NOE dropout and NOE com- 
pletors are different before tliey enter 
secondary scluxol. Tliis question is framed 
in terms of tlie total MISOE input battery 
whi^'h is administered to all students in 
the sample data systems. Using a statisti- 
cal operation called stepwise multiple 
regression, tlie manager asks tor a listing 
of the input variables upon which all ()E^ 
male comf)lett)rs were different* than all 
NOE. dropouts. Again, this question is 
asked for all strata, and secondary stu- 
dents onlyv 

Mana^emvnt Analysis. Of all the vari- ' 
ables in the MISOE Input Battery (sub- 
scores and. a priori Gen Vars), only tour 
are significant in differentiating all NOE 
dropouts, on the average, fronv all OE 
program completors, and they are: 

1. reading skills; 

2. family support for education; 

i. perceived control of the environment by 
the student; and 

4. emotional stability, as Measured by the 
^ High School Personality Questionnaire. 
Taken together, these variables account 
for approximately *60 per i/ent of the 
difference between these two groups of 
students, with reading explaiyhig' about 
20 per cent of She variance; tamily sup- 
port for education about 17 per cent and 
control of the environment and emotional 
stability about 1-2 per cent each. A con-^ 
elusion from this dialogue with the 
computer could be that if all dropouts 
had tlie same scores on tliese input .vari- 
ables, tliey might be j&xpected to succeed 
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at the same rate as OE completors, and 
therefore to iinpact upon society with 
approximately the same range ot 
behavior. Of course, this intormation 
suffers from the sa#ie ^problem ot over 
aggregation as did the information trom 
previous probes, in that, comparisons are 
made between groups across wide* ranges. 
Even though that is true, DOE manage- 
ment .suspects that the variables which 
appear to separate all successful OE 
completors and all NOE dropouts seem to 
be subject to change or manipulation, 
Reading scores can be improved^ family 
support for education is not * totally 
beyond the reach of public education, and 
perceived control of environment and 
, personality' adjustment seenl.the legiti- 
mate focu*s of counseling an'd guidance* 
Although niuch more specific information 
is required for the development of a 
useful policy,' it seems particularly en- 
couraging that there are no differences in 
so-called IQ or other apparently difficult 
to change aptitudes. ^ 

Probe ^'i ^ ' * 

MdHd^ement Inquiry. Having dis- 
covered the* average raw scores ot NOE 
dropouts and-OE completors upon input 
batteries which iiffercntiated these 
groups, DOE IS now toncerend in learning 
tlR\ relative distance \etween 'these groups 
by 'a constant metric, i.e., standard scores, 
IX)E is also concerned about the dif- 
ferences bietween NOE dropouts and 
other identifiable groups by these 
measures^ • ^ 

iMana^ement Analysis, This inquiry 
reveals that NOE dropouts are over two 



^This is a major ct>mmercial for tlie MISOE data design, which not only allows the recognition of 
a problem, but provides for its solution. Assessment of impact only identifies problems, while assess- 
ment of student pfogrcss at points in educational time and which is unrelated to impact and un- 
connected to anything elst, provides httle assistance fbr systematic progress. 
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standard devuitioiis below ()E coiiipletors 
ill reading, taniily, support and CDUtrol ot 
urivironnient at program entry tinle, and 
approxinuitley the- same distance below 
NOE cx)nipletors as destTibed by these 
measures. They arc not quite as *\'()nipar 
atively disadvantaged'' in terms ot 
emotional stability. It is interesting to 
note that they are only about one 
standard deviation Uehjw C)E dropouts on 
these measures, and iu)t/lil'terent at all in 
terms of emotional stability. 

This inh)rniatic)n is another way ot 



saying that \i their scores on these 
variables could be improved about two 
stauthifd deviatio:is bL*t()re they* became 
enrolled in ()E programs^they could be 
expected to succeed aC the same rate as all 
OE couipletors. Again, the data is still too 
gross tor policy reconimendatit)ns, other 
than enormous generalizations, aiid 
considerably more probing oF the 
computer system is required to develop a 
specific policy recommendation which is 
likely to successfully treat an apparent 
problem. 



TABLE 9 

'computer informajion statement 

Target: Mixed Dropouts & Completors, SDS 1 & 2, Cohort 1, 

All Strata, Male, Secondary 
Criteria: Standard Scores of NOE Dropouts to OE" Completors, 
NOE Completors, OE Dropouts 





. ITED 


MPI 


MPI 


HSPQ 




Reading 


Family Support 


Control of 


Emotional 




Total 


For Education 


Environment; 


Stability 


OE Coi^ipletors 


-2.2 


-2.3 


-2.1 


"1.5 


OE Dropouts 


-1.2 


-LI 


. . -.98 • 


^.21 


NOE Completors 


-2.0 


- -1.9 


4.8 


1.4 



Probe ^10 * 

Mcuui^enwyit JliUjiiiry. In summary of 
file developing policy formulation logic 
developed by IX)E in dialogue with 
MISOE during tlie last nine probes, an 
apparently significant problem has been 
isolated, the NOE male dropout. Public 



education produces over one quarter of a 
million nuile NOE dropouts every ten 
years, at a substantial loss to both the 
human beings who expt*.rience this failure 
and to society at large. In social benefits 
ahme, the loss to society is somewhere 
around 7,000,000 dollars for each drop- 
out cohort every fifteen years. The.se 



TABLE 10 

COMPUTER INFORMATION STATEMENT 
Target: Male SDS'l, Cohort 1, All Strata, Secondary, NOE Dropouts 
Criteria; % of Dropouts Who Fall Within + Oc - 1 SD, Mean of Predictive Input Variable 



Note: 

Population: 74% of 28,682 21,225 



a 
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dropouts can be diUVrentiated troni .suc- 
cessful C^E completors in terms ot tour 
indices prior to entering OE programs, 
and it is reasonable to conckide tlut, on^ 
the average, the NOE dropout could hj/ 
expected to do • about as well as aW 
students who enter C)E programs it these 
differences coiild be overcome. However, 
there is a' wide range ot occupational 
education programs currently operational 
at the secondary level (approximately 96), 
and one would expect that the ditferences 
in terms of chances of success tor NOE 
dropouts among progrartis would be sig- 
nificant. Further, DOE management could 

* expect that differences in success rates 
within specific OE programs would vary 
considerably for specific types ot students' 
and that these differences could be ex- 
plained by the educational processes with- 
in programs or by various configurations 
of TERMOBvS acquired by completors 
within specific programs. ConsiderabK-O 
more information is required by DOB^ 
managern.ent to develop a policy to attack 
an apparently significant problem. 

Since considerable variance can be 
anticipated among NOE dropouts, a next 

, reasonable inquiry by, DOE management 
is to determine the estimated number of 
NOE dropouts that can be described -h 
being similar to those who are difte^yit 



than C^^; coi^ipletiwrs on the four so-called 
prj^eiictive input variables, i.e., reading 
>iipabilit^\ family support for education, 
^pei^ceivtHl conCr()l of environment ainl 
emotional stability, 't)Ut otherwise .similar. . 
Probe 10 seeks to discover the number ot 
NOE male dropouts from all .strata who 
fall within one standard deviation of the 
mean of aU NOE male y^fopouts on the 
predicti^i'e input vari^bles* and . are not 
different than OE completors on all other 
input variables. 

Mdiiii'^i'nu'fit . \thdysis. The computer 
statement requires little explanation. 
Approximately 74 per cent of the annual 
26,682 male NOE dropouts fall within 
this range. Obviously, OE management 
concludes than an annual pool ot approxi- 
mately 21,000 human beings represent an 
appro^priate target for major policy devel- 
opment at tht^ .state level. From here on 
DOE refers to this group of students as 
the NOE Target Group. * 

Probe ^11 



Manuj^emait Inquiry, At this point in 
the planning process DOE management i.s 
moving towards a conclusion that part ot 
a poHcy recommendation should include 
what could be described as a remedial 
effort designed to help the NOE Target 



TABLE 11 

^ COMPUTER INFORMATION STATEMENT 

Target: Males, OE Completors & Dropouts, SDS 1 & 2, 

Cohort 1, All Strata, vSecondary 

Criteria: Differential Success Rates'of OE ComplettK* 

' . ., , ' 
OE Corfipletors Whose Scores On , ^ 

Predictive Input Variables Fall; ' 
WitlitA + Or - 1 SD of Mean of all Successtul Completors 
Within + 1 SD ^ Mean of .Ain^uccessful Completors 
Within - 1 SD o£ Mean of All^jtrtretssful Completors 
• Within-^ Or - 1 SD of NOE Dropouts 



VRate of 
Success 

\ 87% 
94% 
72% 
37% 



\ 
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Group become more like successful OE 
conipletors at program entry. Tliis pro- 
gram could occur at the junior high 
school, or at a summer session prior to 
enrollment in regular OE' programs. - 
obviously such a program would have- as 
its goal increasing the capability ot NOE 
Target Groups on four predictive input 
variables! and might include a power read- 
ing program, .particip'htion on the paft of 
the familly NOE^Target Group §tudents in 
a process! designed to help them discover 
ways to be more supportive of their 
children\s| problems in school (and 
probably \ beyoird), and an intensive 
counseling experience, which would be 
focused on 'helping students dev'dlop ' 
confidence and self understanding., How-^ 
ever, even^ if succej^sful, such a program 
could not be expected' to move a large 
number of NOE Target Group students up' 
to the level of OE successful compIWtors ^ 
on all predictive input variables, although . 
it would be reaSonable to expect that, if 
successful, it would account for some 
movement in this direQtiui^,. Therefore,- 
DOE management decides it would be 
usefiil/to develop information about suc- 
cessful OE completori. who , tend to he 
similar to the .N()E Target; Group in terms 
of having achieved scores on the -f)re- 
dictive input variables witliin .the range of 
e5(pectat{ons for the NOE TargpirGtoup at 
the end of the, proposed remedial ex- ^ 
perience. This, group is described as the-^ 
OE Prototype Group, in that they can ^ 
aerve as proxies for the NOE Target 
Group in terms of program planning. 

The first question by DOE management 
of the ()E Prototype Group i^ to learn of 
their comparative success rate to other OE 
students differentially grouped by the 
predictive input variables,. . ^ 

Managenient Analysis. As Dialogue 11 
indicates, 87 out of 100 students who fall 
within ± one standard ^^viation of the 



mean of all successful OE completers on 
the i predictive input variables succeeded, 
on the avenge, across all OE secgndary 
programs, .per cent v^lio Q\\ one 
st^andard deviation above the mean for all 
« successful conipleiors on the predictive 
•variables succeeded, a little ^iiore than 72 
per cent who fall one standard deviatipn 
below the mean succeeded in all OE 
programs ^he OE Prototype Gronf^; 
while only 37 out of 100 students' who 
enrolled in occupational education and 
whose scores fall within ± one standard 
deviation of the mean for all NOE. drop- 
outs on the^predictive variables* succeeded, 
on the average. 

Management is becoming committed to 
a policy position which would be designed 
to move ^^lOE dropouts -''up. to speed" on 
the predictive input ^riables with * a 
remedial program, ' and . expect ,them to 
achieve and succeed at about the same 
r.ate. as the OE Prot;,otjf'pe "Group, How- 
ever, 1t is likely that large numbers of the 
NOE Target Group mighf iind them$elves 
in the very low range of the C)E Prototype 
Group on* the pfedictive input variables at 
initial ^eufollment' time, and unique pro- 
gram consideratioEUS for this' NOE Target 
Group should be inyestigated. 

Probe #/"2 " ' " ^ ' * 

. ^lanageimnit Inquiry. A prior con*-. 
si3erlt<?kin to investigating process alterna- 
tives for /tlte-^r^iOE Target Group, is to 
estimate the costs^^d benefits of imple- 
menting the developing policy. The next 
man-computer dialogue is to estimate the 
average co^ts and bene^ts of male, O^^ 
conipletors, differentiated by spores on 
the predictive input variables. 

Manageinent Arialysis. The .resjiltsj are 
approximately what DOE , rti^S,gfem(?nt 

"might have expected. Program eosts^orjDE 
completers cend to increase ast'^hfey mM^e 
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toward the score of NOE dropouts and 
away from successful completers on the 



predictive input variables, while J:he social 
benefits for fifteen years tend fo decrease. 



TABLE 12 . 
.COMPUTER INFORMATION STATEMENT 
Target: All OE Coinpletors, SDS 1 & 2, Secondary, Cohort 1, 
Male, All Strata, Differential'.,'^ ' y Score on Input Variables 





Criteria: Multiple 
»> 






(1) 


(2) 


All OE Completors Whose 


. / I'Yi- 


15 Yr 


Score on Predictive Input 


Social Benefits 


SocialBenefits 


Variables Fall: 


' Per Student 


Per Student 


J. Within + Or ■ 1 SD of Mean 


S2,893. 


$43,395. 


of Successful OE Cx>mpletors 






2. Within + 1 SD of Mean of 


$3,272. 


$49,080, 


Successful OE.Complctors 






3. Within-*! SD of Mean of 


$2,631. 


$39,465. 


Successful OE Completors 






4. Within + Or - 1 SD of Mean 


$2,211. 


$33,165. 



of NOE Dropouts • 

(1) Program Cost Per Completor Group 

(1) $6521. 

(2) $6322.^ 

(3) . $6671. 

(4) ,$6912. 

(2) All Dollar Values Adjusted to 1976 Dollars 



Probe #1^ ' 



they drop out), and this relatkinsliip holds 
for social benefits. * 




Manag^ement Inquiry. Since at best *i 72^^^^^ 
r cent success ratt? can expected iot^^Probe #14 
ie NOE Target Group from .the develop- 
ing policy, DOE management next probes 
the computer to determine the associated 
p/ogram costs and benefits of all OE 
dropouts (averaged), differentiated by the 
predictive input variables. 

Mana^emer^t Analysis. With OE drop- 
outs the cost of the program tends to be 
less^for dro|[)outs whose predictive input 
scores fall below the raean for all success- 
ful completers (which is probably a 
function of. the point in time at which 

\ 



Management .inquiry. DOE manage- 
ment^sks a deceptively complex question 
SOE (from ^ technical perspective), 
nagement wants to know the costs and 
/benefits for the OE Prototype Group, 
assuming a constant 1976 dollar. This 
calculation is to . include both dropouts 
and completors in terms of their dif- 
ferentiated progt^m costs and social 
benefits. At the same time manirg^ment 
also seeks this same information for the 
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TABLE 13^ . 
COMPUTER INFORMATION STATEMENT 
* Target: All OE Dropouts, SDS i Sc 2, Secondary, Cohort 1, 
Male, All Strata, Differentiated by Scqre on Input Variables 
Criteria: Multiple 



(1) 



(2) 



All OE Dropouts Whose 
Score on Prfedictiv«4nput 
Vilriiblcs Fall: . - 

1. Within + Or-1 SD of Mean 
of Sucf essful OE Cdrnpletors 

2. Within + 1 SD of Mean of • 
Successful OECompletors 

3. Within - 1 SD of Mean of ^ 
'Successful OE Completors 

4. Within + Or - 1 SD of Mean 
of NOE Dropouts 



(1) Program Cost Group 

(1) $5500. 

(2) $5321. 
^ (3) S5200, . 
' (4) $4871. 

(2) All Dollar V,alues Adjusted to 1976 Dollars 





15|Yr 


Social Bpftefits 


Social Benefits 


Per ^Jfudent 


Per Student 




/ 


/ $2,335, 


^35,025. 


$2,712. 


$40,680. 


"$2,001. 


$30,015. 


$1,731. 


$25,965. 

- — e- - 




\ 



OE group that succeeds at the .87 per cent 
rite and the 37 per cent ratc^These data 
are to be calcuJated for the 74 per cent of 
^ the annual male dropouts each year. 

Management Analysis, These result^ are 
indeed encouraging to DOE management. 
Given the average costs and benefits for 



all OE program completors and dropouts 
v^ho succeed at about the 72 per cent rate 
(the Prototype Group), this interaction 
states that the cost benefit ratio (social 
benefits over fifteen years) is 1 to 6, a 
substantial improvement over the 1 to 4 
rate for NOE dropouts on this single 



TABLE 14 

COMPUTER INFORMATION STATEMENT 
Target: 74% of NOE Dropouts Had They Completed OE At Variable Rates 
. Criteria: Costs/15 Yr Benefits, C/B Ratios 



Costs 

15 Yr Social Benefits • 
C/B Ratio 



87% .Rate 

$135,776,331. 
$899,191,020. 
' 1/7 



72% Rate 
$133,038,184, 
$782,591,625. 

. 1/6 . 



Note: All Dollar^ Values Adjusted to 1976 Dollars 



- 37% Rate 
$119,590,441. 
$608,540,040. 

- 1/5 ;' 
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benefit alone. It Is interesting to note that 
while the cost benefit rate tol students 
who hill within *one standard deviaiitMi ot 
all successh'il C)E eonipletors (the H7 per 

-cent .success rate) is as expected, the cost 
benefit ratio of the 37 per cent comple- 
tion group is better' than that of NOE 
dropouts, even with a 67 per cent dropout 
rate. Apparently, this could be another 

^manifestation^ c^f the overkill phenomena, 
worthy of a separate probe. Anyway, all 
tliis is very revvardiiig for^DOE manage* 

^ ment, since if suggests that even if, on the 
average, NOE completors do not quite 
measure up to the OE Prototype Group, 
they are liKcly to hdl soinewhere close to 
this proxy group in terms ot success rate 
,and,will still be within a range that should 
represent improvement over the existing 
educational alternative, 

Prohc ^15 * 

Mandjfcnwiit Jnqituy!, DOE manage- 
ment now turns its attention to attenipt- 
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ing to select occupations and programs tor 
.th'e*NC)E Target Group students from the 
approximately 96 occupational education 
programs now operational. The logic 
employed by D()E management is to 
determine the occjupations in which OE 
Prototype students have been most 
successful. Success is defined by a 
comparatively high score on the social' 
benefit Gen Var, or, operationally, to- 
select those OE Prototype students whose 
social benefit score fall within a range of ± 
one standard, deviation of all OE » 
completors. This is a further refinement 
of the OE Prototype Group and is now 
the reference group for the descriptor OE - 
Prototype Group' The request is designed 
to list those occupations (rank order) by 
the aggregate number of male completors 
who fall witliin the boundaries of this 
newly defined OE Prototype Group. The 
assumption is that these are the 
occupations in which the NOE Target 
Group is most likely to be successful. • 



• ' . TABLE 15 

^ * COMPUTER INFORMATION STATEMENT 

Target: OE Prototype Group . / 

(l) Males, Secondar^f, SDS 1 & 2, Cohort I, All Strata, OE Completors \ 
f^2) Within 1 SD below mean on predictive input variables ' 

(3) Who were employed in related occupation for which trained for at-deast 4 years, ai!fd 

(4) Whose social benefits (Gen Var) were within 1 SD of meao for all OE completors of 
cohort 1, SDS 1 & 2, all strata — ^ — 

Criteria: Rank Order 10 Highest OE Codes by the Number ; 
of Completors of OE Prototype Group Students 

(1) Auto Mechanics - , - * ' 

(2) Machinists * '* j * 

(3) Aueo Body 

, ' ^ (4) Appliance Repair . ^ 

(5) Distributive Occupations 

^ ,{6) House Carpentry 

(7) Mill Work & Cabinet Making 

(S) Air Conditioning 

(9) Office Mackine Operator 

(10) Quantity Foods Occupations 



0 
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Management Analysis. It is necessary to 
evaluate tliese specific occupations in 
which 'the ()E Pn^totype Group has been 
successful by anticipated manpower needs 
over the next ten years. Therefore, DOE 
submits these programs to the Depart- 
ment of Labor with the specific reque'^t to* 
select ""the 'three OE programs in which 
high employment is expected during the 
next ten years.^ 

In summaxy of this probe, these 
occupations represent job descriptions in 
which the OE Prototype Group has suc- 
ceeded, at least in terms of a desirable 
impact as described by social benefits. 
Further, these programs seem to offer the 
promise of high employment and the 
short term future. 

Probe 4P 1 6 

f> / ■ 

Management Jnquiry. DOE's next con- 

cern is to determine the occupational 

skills (TERMOBS) that should constitute 



the learning objectives of OE programs 
designed to prep*are the ^ NOE Target 
Group for entry level into these three 
occupations. DOE's continuing logic is to 
pursue the^ experience of the newly 
defined OE Prototype Group, i.e., stu-» 
dents who fall within ± one standard 
deviation of the NOE Target Group on 
the input battery, who successfully, 
coxnpleted ^n OE program prjp^ring them 
for one of the three selecteo^crccupations, 
i.e.. House Carpentry, Automotive* 
Mechanics or Office Machine Operator, 
and whose score on the social benefit Gen 
Var is within one standard deviation of 
the mean for all OE completors. This is a 
further refinement of the OE Prototype 
Group, and is the final reference group* for 
the descriptor OE Prototype Group from 
this point forward, 

DOE's first question is to determine the 
average number of TERMOBS passed per 
OE prototype completor, the quality* 
score (QS) on each TERMOB, as well as 



TABLE 16 

COMPUTER INFORMATION STATEMENT ^ * 
Target: OE Prototype Group ' 
Criteri^a: For 3 High Success OE Codes for Prototypical Completors: / 
• (1) Mean SD TERMOBS Passed & Failed ' ^ 

(2) QS for TERMOBS Passed & Failed 





USOE Code 


USOE Code 


USOE Code 




i7.ipor 


17.0302 


14.0104 


41 


Carpentry 


Auto Mech 


-Officer Mach Op 


Average Number 


31.2 


28.3 


29.1 


TERMOBS Passed 








QS 


^ 3.38 ' 


3.71 


3.21 


Average Number 


2 


4 - 


2 


TERMOBS Failed 








QS 


♦ 1.8 


1.7 . 


• 1.9 



^This list is purposely truncated to krep the example simple. The foUowin^g list returns from the 
Department of Labor: (1) House Carpentry;' (2) Auto Mechanics and (3) Office Machine Operator.* 
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information about the number of Probe #17 
TERMOBS failed. 

Management Analysis. The data speaks 
for itself. The OE prototype completor 
passed about 30 TERMOBS per student 
with a quality score of about 3.5, while 
they only failed about two to three 
TERMOBS per student. This information 
seems to set a preliminary range for the 
learning objectives for th^ NOE Target 
Group. * . 



Management Inquiry. Merely knowing 
the average number of TERMOBS passed 
does not provide the substantive informa- 
tion required to develop a very definite 
recommendation about the learning objec- 
tives for specific occupations for a par- 
ticular group of target students. Accord- 
ingly, management now requests a listing 
of the TERMOBS* passed by more than 80 



TABLE 17 
COMPUTER OUTPUT STATEMENT 
Target: OE Prototype Complctors 
Criteria: List TERMOBS Passed by More than 80% Prototype Completors 

USOE CODE 17.1001 USOE CODE 17.0302 USOE CODE 
TERMOB # QS. TERMOB # QS TERMOB # 



004 
005 
007 
009 
010 
016 
017 
019 
021 
022 
024 
026 
031 
038 
042 
050 
051 
052 
053 
071 
*072 
074 
075 

6so 

081 
082 



4.1 

3.8 
3.7 
3.3 
4.0 
4.4 
3.2 
3.8 
3.9 
4.6 
4:2 
3.2 
4.4 
'4.1 
4.0 
3.9 
3.8 
3.4 
3.7 
3.9 
4.1 
4.7 
4.3 
■3.7 
4.0 
4.1 



009 

010 

Oil 

012 

041 

042 

046 

051 ' 

055 

056 

058 

062 

063 

06";^ 

071 

073 

075 

076 

077 

078 

079 

084 

092 

094 

095- 



3.8 
4.7 
4.6 
3.2 
3.7 
3.9 
4.2 
4.0 
4.1 
3.7 
3.7 
3.2 
3.5 

ij 
3.8 
4.8 

4J 
3.6 
3.7 
3.2 
3.4 
3.4 
3.7 
4.2 
4.6 



001 
002 
003 
004 
00* 
007 
Oil 
018 
020 
022 
026 
027 
028 
029 
030 
"07 1 
072 
076 
081: 
082 
083 
087 
088 
092 
093 
Q95 



14.0104 
QS 



4.2 

4.8 

4.1 

4.7 

4.2 

4.1 

3.6 

3.3 

3.7 

4.2 

4.0 

4.7 

4.7 

4.6 

4.5, 

3.7 

3.9 

4.1 

3.9 

4.2 

4.1 

4.0 

3.8 

3.5 

4.0 

4.2 



TOTAL 



26 



3.93 



,25 



3.87 



26 



4.07 



114 
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per cent of the neVvly defined OE proto- 
type students, by liSsOE Code. * 

Mana^ctncnt . •^}hily^i<. This Hst of 
TERMOBS represents thost? -entry level 
occupational skills that a majority of the 
re{ined (through analysis) C)E Prototype 
Group have passed, and represents a solid 
^isis- tor program content recommenda- 
tions. However, since 'occupations are 
frequently updating themselve:^ in light ot >: 
technological breakthroughs, and since 
these TERMOBS could include obsolete 
skills and - might not reflect recent 
developments, these TERMOBS are now 
jiiibmitted to several industrial advisory 
groups (one tor each occupation). The 
groups rate these TERMOBS from a per- 
spective of Usefulness in the marketplace 
during the i^ext ten years, and add aijy** 
new TERMOBS that seem important from 
the list o/ MISOE's continuously updated 
'TERMOB information bank. This final list 



of TERMOBS constitutes the learning 
objectives for the occupational programs 
within each of the threb analytically 
determined occupations for the NOE 
Target Group. 

Ahuia^cnimt Inquiry. It is now possibll* 
for the ^ DOE management to begin 
developing a ]p*olicy recommendation 
which will describe tlie Target Group of 
students, a remedial prograin^and specific 
occupational skills or learnings^ objectives 
within specific occupations. It is also 
possible CO estimate, averaged over all OE 
programs, the costs ' and benefits of 
these progranijS for the >Target Group of 
students. A more caneful probe of the 
,data files will pernih a- 'more specific 
estimation of costs and benefits for the 
Target Group. Of prior interest, however, 



TABLE 18 

COMPUTER OUTPUT STATEMENT ' f 
Target: OE Prototype Group & All OE Dropouts, Cohort 1, SDS 1 & 2, 
Male, Secondary, All Strata, Whose'lkput Scores on Predictive Variables Fall Within 1 SD 

of Prototype Group . 
Criteria^ Stepwise Multiple Regression * 
Dependent Variable: Completors / Non Complctors 
Independent Variables: MISOE Process Battery, M SD, % of 
Contfibution to Variance of Indepertdent Variables 







R = .81 












Length 
of 


> Admin Init Plan 




) 

Satis 


Stud 
Attit 


Cleric 










Coopi 


Stud Inst Inst 


Moon 


With 


Toward 


Teach 




Prog. 


Eval Mat * Activ 


Light 


Teach 


School 


Duties 


OE Proto 


8 Mo 


^ ' 12Hr/Wk 


2.1 Hr/Wk 


18.4 , 


16.1 


2 Hr/Wk 


Completors 


SD .5 


.12 


1.1 


2.1 


1.1 


1.1 


OE Dropouts 


3.1 Mo 


7 Hr/Wk 


.9.6 Hr/Wk 


9.3 


11.2 . 


5 Hr/Wk 




SD 4.2 


3.2 


1.2 


2.4 


3.2 


7.2 


% Contribution 


17% 


17% 


12%a 


* 9% 


7% 


6% 


to Variance 















Ill 



is a description of the characteristics ot 
the process variables of the occupational 
education programs for the Target Group. 
It appears reasonable to ekpect tliat the 
developing policy recommendation will 
suggest that new programs will be insti- 
tuted for tafget students, to include both 
a preoccupaticSnal remedial program and 
occupatio|ial education programs designed 
to prepare the NOE Target Group with 
specific TERMOBS in named occupations. 
It is likely that the recommendation will 
suggest that ^the new programs be insti- 
tuted and maintained by the staff of 
existing ^schools/ and will involve some 
expansion of occupational education 
facilities and staff, with a concurrent 
reduction in the nonoccupational delivery 
system at the secondary level. 

DOE'S ntfxt logicaj information require- 
ment is to estimate the characteristics of 
the occupati6nal education programs for 
policy^ recommendation. To develop this 
information DOE decides to determine (in 
terms of. the MI50E process l?attery) 
differences, if any,' lietween all OE Proto- 
type Students and all occupational educa- 
tion dropouts from kll programs whose 
scores on the predictive input variables are 
like those of the OE Prototype Group 
and, of coursie, the NOE Target Group. 
Such a strategy will provide a broad based 
comparison for estimating the- value of 
specific process elements for the NOE 
Target Group on the basis of successful 
past perfotrmance. 

Management Analysis. The result of 
this interaction indicates that the OE 
Prototype Group can t^e differentiated 
from all occupational education dropouts 
who are similar to them in terms of the 
predictive ' input variables 'by six process 
variables of the MISOE process battery. 
Approximately 17 per cent of com- 
pletion/noncompletion differences can be 
explained by the length*of the cooperative 



program. The length of the average co- 

* Operative program for the OE Prototype 
Group is eight months. Administratively 
initiated staff {planning of student evalua- 
tion,' instructional materials and instruc- 

j tional activities account for about 15 per 
cent of the differences between comple- 
tors and noncompletors. The OE Proto- 
ij^pe Group are in programs where the 
average planning hours per week, on these 
three functions is twelve, while for 
occupational education dropouts planning 
time? is only about three hours p^r staff 
member per week for these three ,func- 
tions. 

Moonlighting is ■ described ^Jay Hilre' 
MI^OE process battery as^orfing for pay ^ 
in a nonteaclrifig function, and this vari- 
^^abhr accounts for about 12 per cent of the 
variance between these groups. The OE 
Prototype Group is in prograrfis whose 
faculty moonlight about 2.1 hours per 
week, ^ while the -average staff member's 
moonlighting score is about 10 hours per 
week for the occupational education 
dropouts: The perceived satisfaction of . 
the faculty for teaching and the positive 
attitude of the students toward school in 
combination account for a little over 15 
l^per cent of" .the differences between 
^^mpletors and noncompletors. Interest- 
ingly, the average facuKy member spends 
about five hours per week on clerical 
teaching duties in programs attended by 
occupational education dropouts, as 
compared to about two hours a week for 
the OE Prototype Group. , 

W summary, these six process variables* 
Recount for about a little over 60 per cent 

* of the differences of occupational educa- 
tion dropouts for all secondary programs 
and the OE Prototype Group. This infor- 
mation provides documented, clues about 
important characteristics or programs for 
the NOE Target Group. With the excep- 
tion of satis^ction toward^ teaching and 
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*studen^ attitude toward school, /all these 
variables seem susceptible to manipulation 
by management, and ccnild form a basis ^ 
tor program guidelines withiii a polic)^ 
recommendation statement. 

Probe #19 

iMana^cnioit hiquiry. Other charac- 
teristics of OE prc^g^ims are necessary to 
specify program components for the NOE 
Target Group in a useful policy statement. 
Probe 19 is designed to provide informa- 
tion tor these program components in 
terms average scores for OE Prototype ' 
Students on these pi'ogram elements, and 
standard scores for the OE Prototype 
Group. These scenes describe the dif- 
ferences between these program elements 
ior the OE Prototype Group and those ot 
all programs preparing House Carpenters, 
Auto Mechanics and Oftice Machine 
Operators. These standard scores provide 
an estimate ,^of the degree of change, on 
the average^"' that should be sought to 
recondition existing programs to meet the 
needs of the NOE Target Group» 



Mdiuif^emcnt^^hhilyds. On program 
characteristics which -do not seem to 
differentiate OE proto'type completors^ 
and a comparison group ot noncomple- 
tors, but are none thef ess essential to 
planning, it appears that other than 
faculty inbre,eding, the 'scores tor OE 
Prototype Students are practically the 
same asv for all programs preparing 
students in thesc^ occupations. Average age 
is torty-seven, with a fairly wide, range, 
faculty degree status is not very different, 

^ith about one half at the bachelor'.s level 
or less, average years of experience in the. 
field in which teaching is 3.1 , which could 

' constitute a surprise for existing standards, 
verbal IQ is high average, and the length of 
program, averaged over students, is 2.8 
years, appears that the faculties that tend 
to be associated with the OE Prototype 
Group tend to be somewhat less inbred 
than the average program, when inbreeding 
is described in the MISOE process battery 
as staff mix as differentiated by place of 
birth, place raised and place attended 
school, in relationship to the school in 
which currently teaching. 
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TABLE 19 

\ COMPUTER INFORMATION STATEMENT 
Target: OE Prototype Group & All OE Students Enrolled in House Carpentry, 
Auto Mechanics, Or Office Machine Operator, Cohort 1, SDS 1 & 2, Male, Secondary, All Strata 

Criteria: (1 j Difference in Standard Scores Between OE Prototype Groups and 
' ^ / All OE Students in Selected OE Programs 

(2) Mean, SD for OE Prototype Completors 
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Probe ^20 

^ana^etmnt Inquiry, ManagoiiU'ilt has 
devmoped a 'fairly reasonable basis for 
recommending specific occupational edu- ^ 
-cation programs, TERMOBS within 
occupations and program characteristics 
for the NOE Target Group of 21,000 
students. Further, it seems possible to 
provide a beneficial experience for both 
the Target Group and society in terms of 
societal costs and benefits, without maj^r 
alteration'* of exktmg programs. However, 
public education is obviously more 
broadlv Tocused than career preparation. 
Therefore, DOE management is concerned 
with what could be described ' as the 
opportunity cost of occupational educa- 
tion, i.e., what is the price in terms of 
nonoccupational education lost. * 

The same logic 'that DOE has been 
pursuing to this point can be extended to 
provide an indication of the non- 
occupational consequences oi: tlie existing 
mix of occupational and nonoccupational 
education as currently pri^ctiCed. The 
appropriate comparison is the OE Proto- 
type Group. . 

However, DOE management also selects 



NOE cqmpletors who fall within about 
the same range as the Prototype Group 
on the predictive input variables, all OE 
rompletors and all non-OE completors. 
The iirst request is for information 
describing the comparative general educa- 
tional development of these groups (as 
measured by specific scales on the ITED 
posttest). The request is made to provide 
a standard score comparing the OE Proto- 
type Gifoup to other named groups. 

Mana^etnent Analysis, The OE Proto- 
type* Group, seems to achieve . less in 
reading and social studies than all OE and 
NOE completors, on the average. The 
reading composite was probably expected, 
given their scores before they entered the 
program. The social studies score was 
somewhat unexpected, but there could be 
some relationship between this and the 
reading score, as it might reflect the 
process by which social studies, is 
presented in public education. It is en- 
couraging to DOE that the OE Prototype 
Group does no worse (and slightly better) 
than their NOE counterparts on these 
measures oA general educational 
development. IBOE management con- 
cludes that although there seems to be no 



jrABLE20 
COMPUTER lNl?bRMATION OUTPUT 
' Target: OE Prototype Group & All OE & NOE Completors, Cohort 1, S6s 1 & 2, 
All Strata, Secondary, By Specified Groups 
Criteria: Standard Score Comparison of OE Prototype Group Score 
. To All Other Completors on Selected ITED Posttest Subscales 
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Reading 
Composite 


Social 
Studies 


Math 


Science 


NOE Completors Who Fall 
Within Same Range on Pre- 
dicted Input Variables as 
OE Proto Group 


} 


+ .01 
(* 


+.62 


+.71 


All OE Completors 


4.12 


-1.01 




-.75 


All NOE Completors 
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118 


-1.43 
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-.84 


-.41 
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apparent opportunity cost to the tradi- 
tion al 6 c c 11 patio nal-nonoccupational 
education mix currently nftered tor C^E 
prototype st.udents as measured by the 
Iowa Test of Educational Development, 
their recommendation will include a stiite- 
ment about these findings i^nd a sugges- \ 
,tion to seek improvement in t4iese capabil- 
ities fof the NOE Target Group students. 
However, this assessment does not provide 
any curricular clues to remedy this 
apparent deficiency, as a longitudinal 
information system does not includ^uipn- 
("^cupational education. 



Proln: i?21 



MtUhij^cnictit Inquiry. To estimate the 
differential impact or opportunity ^fiost of 
the current occupational education pro- 
gram mix at the secondary level for the 
NOE Target Group is a straightforward 
matter with MISOE's longitudinally con- 
nected Sample Data Systems. For five 
Gen Vars (interactively specified by 
maftagement at tl;e' terminal)^ DOE 
management requests a comparison 
between the OE Prototype Group and the 
other' groups specified in Probe 20. DOE 



specifies that these*^ scores be expressed in * 
standard scores which describe the dif- 
ference between the OE Prototype Group 
and the other n^med groups. 

Mdjuigenicnt Atiahsis. The most glaring 
finding iS the substantial differences 
between the OE Prototype Student and 
their NOE counterparts. The OE 
Prototype Gfroup * appears to be 
comjistently different (better) in terms of 
productivity, community service a nd j ob 
satisfaction, as measured by tht^ 
impact instrument. There seems to be nj: 
differences in participation in spofis. 
TKere seems to be little difference 
between OE Prototype Students and all 
OE and NOE completors on all of these 
measures, witly the exception of voting 
behavior. This could be related to the 
social studies deficiency revealed in Probe 
20, and further strengthens the 
recommendation to "beef up" the social 
studies program for the NOE Target 
Group. 

Probe #22 

Management hiqnfry. Previous cost and 
benefit information was based on all OE 
and N^E averaged over all subgroups of 
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TABLE 21 
COMPUTER OUTPUT STATEMENT 
Target: OE Prototype Group & All OE & NOE Completors, Cohort 1, 
SDS 1 & 2s All Strata, Secondary, By Specified Groups 
Criteria: Standard Score Comparison of Selected Input Variables 
(Gen Var) to Selected Completer Groups 
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TABLE 22 

COMPUTER INFORMATION STATEMENT 
Target: OE Prototype Group 
Criteria: Cost by OE Code and Specified Functions and By 
Academic and By Nonacldemic Per Complctor 

USOE Code''l7.0302 



USOECode 17.1001 



USOE Code 14.0104 





OE " 


Acad 


Total 


OE 


Acad. 


Total 


OE 


Acad 


Total 


Staff ' 


$2317. 


$1222. 


$3539. 


$2550. 


$1200. 


$3750. 


$2219. 


$2001. 


$4220. 


,Inst^ 




















Mat& 


SlllO. 


$ 658. 


$176«. 


$1092. 


$ 669. 


$1761. 


$ 810. 


$ 513. 


$1323. 


Equip 




















Capit 




$ 458. 


$1171. 


$ 708, 


$ 435. 


$1139. 


$ 820.^ 


$ 398. 


$1218. 


Total 


$4140. 


$2338. 


$6478. 


$4060. 


$2590. 


$6550, 


$3849. 


$2912. 


$6761. 



Note: All Dollar Values Adjusted to 1976 Dollars 

Students,, Now, however, DOE req^ik^ Carpentry, Auto> Mechanics and Office 

more specific in forma t ion for its policy Machine Operators. 

recommendation. Accordingly, they re- Management Analysis. None. 

quest a cost description (estimated in 

1976 dollars) tor copipletors, line itemed Probe #23 

by staff, instructional material and 

capital, for each OE program and its Manageme);tt lmjtiiry. Since the MISOE 

counterpart academic mix for these three Cost System provides information about 

occupations to be recommended for tlie cost for dropouts, and since DOE manage- 

NOE Target Dropout Group, i.e., House) \ ment anticipates approximately a 28 per 



TABLE 23 

.C:C)MPUTER fNFORMATION STATEMENT 
Target: Prototype Cropouts 
Criteria: Cost By OE-Code and Specified Functions and By 
Aciidemic and Nonacademic Per Dropout 



USOE Code 17.1081 
Acad Total 



Staff $1761.^^79. S2840. 
Inst 

Mat& S1035. S 605. $1640. 
Equip 

Capit S 460. S 270. $ 730. 

Total S3256. $1954. S5210. 



USOECode 17.0302 
Oe' Acad Total 
S1794. % 966.. $2760. 

$1125. $ 605. $1730. 

$ 490: $ 321. $ 811. 
$.3409. $1892. $530U, 



USOECode 14.0104 
OE Ab>d. Total 
$1^590.* $1060-1^^50. 

$1044. $ 696. $1740. 

$ 450. $ 300. $ 750. 
J3084. $2056. $5140. 



Note: All Dollar Values Adjui>ted to 1976 Dollars 
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cent dropout rate, costs are requested for 
OE prototype 4ropouts. 

Management AnalysU. None. 

Probe #24 ^ 

Management Inquiry, Management also 
requires specific information for OE Pro- 



totype Completor^ and Dropouts describ- 
ing social benefits. Previous information* 
, lias been averaged over all OE programs. 
Management Analysis, This information, 
is approximately what should have been 



expected 
probes. 



as 



resu 



It of 



previous 



TABLE 24 

COMPUTER INFORMATION STATEMENT 
^ Target; Prototype Dropouts & Completors 
Criteria: Average Social Benefits Over 15 Years 

4 Annual Social 

Benefits 



OE Prototype Dropouts ^ $2,231. 
OE Prototype Compfetors ' ' $2,701. 

Note: All Dollar Values Adjusted to 1976 Dollars 



15 Yr Social 
Benefits 

$33,465. 
$40,515. 



Probe #25 ^' 

Management Inquiry, The final inquiry 
of this probe series is a request for a 
specification of the comparative costs and 
benefits of a tentative policy statement 
recommending the initiation of a specific 



program for a specific targejt group. The 
reason for qualifying the policy as tentative 
does not reflect uncertainty on the part of 
DOE management, but rather a strategy of 
not firming up specific policy statements 
until they can be analyzed iti light of a total 
array of policy recommendations. 



. ^ TABLE 25 
COMPUTER INFORMATION STATEMENT 
Target: 21,255 NOE Dropouts 

Criteria: Policy Alternatives in C/B Metric 

e 

OE Alternative 



72% Success Rate 
21,255 Students 



Per Pupil Cost 



Sec Prog 

Jr. Hi Remcd 
Program 

Total Cost 

Total Benefits 

C/B Ratio 



Completors 
$6630. 
$ 500. 



Dropouts 

$5217. 
$ 500. 



Traditional Program 

21,25^ Students . 
Per Pupil Cost 
$3000. 



$143,139,387. 
$819,938,735. 

1/6 



Total Cost 
Total Benefits 
C/B Ratio 



$ 63,765,000. 
$285,986,025. 
1/4 



Note: All Dollar Values. Adjusted to 1976 Dollars 



Model l\)licy^*iXwinw}idation 

(tOiiL T(x prSlUe an occupational edu 
cation altetname for approximately 
21,000 annuqjr., male drc^pouts From 
secondary pubfi? education as a plamied 
social interyemion Resigned to improve 
the economic welfy^ ot this target group 
in ternvi^jff private benefits and to accom-^ 
plish tirifSn a way that represents a better 
soeiaf iifvestment than the existing 
secondary educational program. The fol- 
lowing table describes the anticipated 
costs and benefits as^sociated with the 
implementation ofjtlje program recommend- 
ed by tliis policy statement (show table). 

Lo^ic, Twenty-four thousand ot the 
28,000 annual male dropouts were found 
to have been enrolled in nonoccupational 
educatioiv-AitluHigh the-co&t-t>f pr^mding 
nonoccupational secondary education for 
these dropouts is approximately half ot 
occupational education, the ^extra social- 
benefits aggregated over only titteen years 
favorably offsets this additional investment. 

It was discovered that about 75 per 
cent of the male dropouts were no dit- 
ferent than students wlu) could be c\ 
pected to suceed at about ah 87 pef ct^nt 
rate on most pre-entry social and 
psychological measures, except for tour 
crucial variables; reading comprehension, 
family support for education, perceived 
control of environment and emotional 
stability* The differences oh these indices 
were significant. On the assumption that 
planned modification of these capabilities 
is within the range of the traditional role 
of public education in 'America, it is 
suggested that a remedial program just 
before entry into occupational education 
be initiated to improve the scores ot these 
dropout pnme Students in Terms of these 
so-called predictive input variables. 

Given the distance, between the, male 
NOE dropout and the average successful 



OE colnpletoi:, however, it is not assumed 
that a short" tjt^rm, intensive remedial 
program focused (ni*these specitic out- 
comes will hiring a large proportion ot the 
NOE. dropout population up to a range 
equal to the average OE completor. It is 
•^therefore suggested that a simultaneous 
effort should be mounted, designed to 
develop* OE programs in which the NOE 
dropouts are more likely to suceed than in 
the traditional occupational education 
program that seflms to work well tor the 
average student. On .the a.ssumption that 
the intensive remedial program just prior 
to entry into an occupational education 
program will be partially successful in 
moving the male dropout prone student 
toward the average scores of, successful 
occupational education ccMnpletors on 
these four critical, predictive variables, the 
characteristics of the recommended 
occupational education programs tor this 
target group is based on the previous 
experience of similar students who have 
been successful in occupational education. 
The occupations for which this recom- 
mendation suggests thiit these students be 
prepared with entry level skills are those 
in which students like these have demon- 
strated success in the past and which offer 
Jiigh employment opportunities during 
the next ten years. 

This recommendation states that these 
goals can be attained without a uTtijor 
alteration of currently , exi.sting programs 
which prepare students with entry level 
skills for these occupations, and about the 
same success rate can be expected for 
these male dropout prone students .as 
exists for the current population enrolled 
in occupational education, i.e., a success 
rate of about 72 out of 100. Such an 
outcome would provide a substantial 
improvement to the existing public educa- 
tion alternative for these dropout prone 
students. Based on the experience of' 
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siTmlar studentSj it can be assumed that a' " 
mix of occupational and nonoccupational 
education similar tb that currently offered 
in traditional programs will not result in, 
penalizing the male dropout prone 
students in terms', of general education 
development. 

Specific Program Recommefidations 

This section of the policy recommendii- 
tion would include a specification of the 
Target Group, the occupations for w^iich 
the Target Group should receive training, 
specification of' the TERMOBS within 
each occupation, and a description of the 
program characteristics. Also included 
would be (;ost. information. Since all this - 
has been previously spt^cified in the probe, 
it will not be repeated at thi? time. One 
recommendation that might be mentioned 
in passing is the description of an appro-- 
priate evaluation process to gauage* the 
progress of participating LEAs during 
implementation^ which would include 
mei^suring the process, product and input 
variables in light of the recommendations. 

bnplenioitation ^ 

The specification of implementation is 
beyond the scope of,, this chapter, 
although* it is assumed that implementa- 
tion recommendations would include: 

1, A pilot phase; 



'2. A guidance coinpoTient; "which allows ' 
students an opportunity to assess their 
benefits iind costs if they decide to 
participate in the recommended program; 

3. Evidenc/ of interaction wth appropriate 
governmental agencies; ' 

4. Appropriate fundinginechanisms; 

5. An opportunity for the local education 
agency to participate in program m edifica- 
tion during the adoption phase. It is 
important not to stifle the potential 
impact of concerned human beings who 
are likely to have a milliolf good ideas on 
how to op era tear program —To use research 
information in program development 
requires the very best effort of the very 
best administrators. To conceive of MISOE 
as a substitute for good management is a 
mistake. 

" ■ * 

Epilogue 

This probe has been simple minded in 
that it has generalized over a number of 
important distinctions that would nee(^to 
be considered by management, which 
include school type, geographical/ setting, 
logistics of the delivery system, /etc. Nor 
lias this probe attempted to account. for 
the rich variety of informationfof MISOE. - 
The purpose of this exercise uas been to 
demonstrate a proces. of manning with an 
interactive computer inforrr/ation system. 
It is this process tliat represents-4;lie goal 
and purpose of MISOE. - V / 
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CHAPTER 9 

EDUCATIONAL POLICY AND SYSTEM DYNAMICS 



Michael Caret 



Faiiures of xuicrs arid statesmen to predict 
even tKe pragmatic outcome of their political 
decisions, let alone their moral and spiritual 
effects, may tu!rn out to'be not the exception 
but the rule; and the Augustinian despair that 
politics could be anything but evil may take 
hold once again of man's imagination 
{Dcutsch, 19,66), 

The final outcomes of policy decisions- 
in education are ill understood. The 
effects- of programs implemented with 
great hope often seem inadequate when 
compared with their original intent, and 
unexpected secondary consequences often 
.contradict program objectives. Recogni- 
tion of this problem as not new: students 
of politics since the time of Plato have 
debated ways to imptpve the .capacity of, 
government to achieve just and human 
purposes. 

This essay explore-i the methodology of 
a new discipline, system dynamics, as an 
approach to the analysis pf decisions in 
eaucation. System dynamics is a social 



system modeling process, which permits 
the examination, tjirough computer simu- 
lation, of alternative social policies. Dis- 
cussed in the essay are technical consid- 
erations underlying the system dynamics- 
approach and methodological issues 
important in its application. In particular, 
the 'chapter addresses the uses of system 
dynamics in the Management Information 
System for Occupational Education, 

Systems Analysis and Educational Policy 

A number of empirical ''systems anal-- 
ysis'' methodologies have been" suggested 
to improve understanding of broad social 
policy outcomes. The Planning-Pro- 
gramming-Budge^B^^ System (PPBS) is 
perhaps the most wiSfely known 9f these. 
Unfortunately! the hopes held by the 
proponents of these techniques have not 
yet been empirically substantiated 
through continued implementation in 
public affairs. 
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have been little used in governnrent is not 
too surprising: there is httle incentive for 
their use; they are ill-understood by 
administratoVs and legislators; the tech- 
niques are time-consuming and difficult to 
J apply;*. tliere are problems ot validity, 
I • accuracy, and conflicting results; and 
, Xjhere are few, if any, successful cases to 
^ use as examples. When the techniques are 
used,, the uses* are often not, the ones 
proponents expect. For example, data 
from system studies have been used as 



~&ystefff~l^yttxmtiei? ' — — 

Present policy issues, such as the low 
educational attainment of poor children 
or worker dissatisfaction, are the result of 
many diverse social conditions, some of 
which have accumulated over many years. 
These social conditions have emerged 
from tlie actions of individuals and groups 
within a complex network of values, laws, 
beliefs, and technologies. This fabric of 
social actions can be interpreted as a 



i^ocial system, and it is this conception 
amnauxu4Jon^Xar-Xhe^arioius--pa^^ — syste m dyn amix:s^^ 
adversary procedures pf interorjganiza- approach. 



tional politics; as the cAhesioA of organi- 
zational alliances; as symbols for tlie 
persuasion o^f pubhcs; and as new grounds 
for organizational creeds. (Biderman, 
1966). • 

Harold Wilensky has suggested a 
number oi requirements information must 
meet if it is to be taken into account by 
government policy-makers. It must be: 
clear because it is understandable ^to those 
who must use it; timely because it gets to 
them when they need it; reliable because 
diverse observers using the same procedures 
see it in the same way; i^alid because it is cast 
in the form of concepts and measures that 
capture reality (the tests include logical con- 
sistency, successful prediction, congruence 
^with established knowledge or mdependeiU 
sources); adequate because the account is full 
(the context of the act, event, or Hfe of. the 
person or group is described); and wide- 
ranging because the major policy alternatives 
promising a high probability of attaining 
. organizational goals are posed or new goals are 
suggested (Wilemsky, 1967). 
Rarely is ihfortnation v^ith these qualities 
available to decision makers in govern- 
ment. The system dynamics approach 
suggests directions for the development of 
social intelligence having the characteris- 
tics Wilensky describes. 



A social system, is composed of the 
interrelated actions of individuals and 
groups. As an illustration,^ the "economic 
system'** involves such actions .as pro- 
ducing goods and services, hiring and 
firing labor, and coordinating scarce * 
resources; the **political system" includes 
such actions as giving and withdrawing 
political support, choosing goals and 
effecting policies, and amassing the pro- 
ductive capacity to carry them out. 

Any real, "concrete" social system, 
such as a city or school, involves an 
unlimited variety of* activities. Economic, 
political, educational, technological, and 
religious actions . are interconnected. To 
study a particuhir "real" social system, it 
is therefore essential to select for analysis 
those few actions considered to be most 
important. A purposeful,* simplified repre- 
sentation of a social" system is termed a 
''model'' The most common social system 
models, in the field of economics, concern 
national income and unemployment. 
Other examples inchcde models of United ' 
Nations peacekeeping, urban stagnation, 
and the political dynamics of developing 
nations. (See Alker, ] 973; Forrester, 
1969; and Brunner, 1971) 

Models are important because they can 
be used as "laboratories" to gain under- 
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stancling of a"social"by3teni. A city map is 
a modf'l that allows an individual to 
compare alternate routes in a city without 
actually traveling along, them. In many 
cases, a model may be the only realistic 
way to gain experience with a system, 
because activity in the xeal system is 
infeasible, costly ,.or impossible. Models of 
forces in earth-moon space, for example, 
are used to plan Apollov moon-flight tra- 
jectories, since actual manned * flight 
experiments would be ^ expensive and 
dangerous. Particularly important are 
-abs^fa^'^ models ■ ^x-pgasse d -A^- m^he-- 
matical notation, because such models can 
be studied extensively using modern 
matheryatical methods and computer 
analysis. 

Jay W. Forrester, professor" of manage- 
ment at the Massachusetts Institute of 
Technology, presents a strong argument 
for the use of models in social policy-, 
making: 

Our social systems are far more complex 
and harder- to understand than our tech- 
nological systems. Why, then, do we not use 
the same approach of making models of social 
systems and conducting laboratory experi- 
ments on those models before we* try new 
laws ' and government programs in real life? 
The answer is ©ftcn stated that our knowledge 
of socijil systems is insufficient for construct- 
ing useful models. But what justification can 
there be^for the apparent assumption that we 
do not know enough to construct models but 
believe we do know enough to directly design 
new social systems by passing laws and start- 
ing new social programs? I am suggesting thi\t^_ 
we now do know - enough to make useful 
models of social systems. Conversely, we do 
not know enough to design the most effective 
social systen\' directly without first going 
through a model-builditig experimental phase. 
But I am confident, and substantial support- 
ing evidence is beginning to accumulate, that 
the proper use of modeis of social systems can 



^ea7H:d"f^r better systems, iUws, 
(Forrester, 1971a). 
The system dynamics 



r pro grams- 



approach 

emphasizes the development of models 
which explicitly take into account the 
structure, of the social system under 
study. System structure describes the way 
in which present system conditions are 
ttansformed int*^ future conditions — that 
is, the structure of a system is a set^ of 
• rules from which^ all futyije, system 
behavior cafT^e derived, . given^ present 
conditions (and given any future external 
-itifttie^Kres-onr-tbe-^ste^ 



As a simple illustration, consider the 
abstract system containing only the five 
letters of the alphabet, A,B,C,D, and E. 
The following rules might describe the 
system structure: 

B^A ^ 

D^B 

: E^B 

These rules indicate how the system 
evolves through time. For example, if the 
system initially js in condition "E," it 
next moves to stat^ "B,'* followed by "A'* 
and so on (See Bellman, 1973). 

In a social system, feedback relation- 
ships ^.mong actions and conditions in the 
system form the basis of system structure 
by ' determining the manner in which 
system conditions^ are transformed 
through time. Forrester describes the 
notion of feedback in detail: 

The most important concept in establishing 
the structure of a system is the idea that all 
aaTons-t^ke^j^Iace^within "feedback loops," 
The feedback loop iT^^^-^losed path that 
connects an action to its effect on the 
surrounding conditions, and these resulting 
conditions in turn come back as "informa? 
tion" to influence further action. We often 
erroneously think of cause and effect 
flowing in only one direction. We speak of 
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actton A cau&irTgTesurt E7'But' siicfi Xperccp^ 
•tion is incomplete. Result B represents a new 
condition o( the system that changes the 
future influences that afffect action at A 
(Forrester, 1971b). 

For example, in the political relation- 
ship between a school system and the 
community, students and their parettts 
seek certain services from tjic schools, iMid 
school pcofes.sionals offer certain services 
16 the comifnunity (although not always 



tire services^'denianded). TKe~educationar 
Services given affect students and their 
families, thus influencing their demands 
upon the schq^jls. Similarly, the demands 
of students and>garents upon the school 
system affect.the schools and consequently*" 
influence the services given. This system 
view of school politics involves a basic 
feedbark loop structure, which can be 
represented in aisimple "loop"-diagram (see 
figure 1, based on Roberts, 1972). "* 



Characteristics of 
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Educational 

Services. 

Given 
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Parents 



Educational 
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Demanded 



FIGURE 1:- Simple^Feedback Structure 



In summary, a system dynamics modeL 
is a mathematical representation- of the 
feedback loop, structure of 'a social sys- 
tem, based upon several central assump- 
tions about structure. First, the structure- 
of a system is dynamic; that is, the 
structure accounts for the transformatiop 
of^system conditions from one rhoment in 
time into the future. System structure 
indicates how present conditions lead^fo 
future conditions. Second, a structural 
model has as its purpose the explication 
af the dynamic behavior of a well defined 



.concrete system. Third, the structure of"a 
System dynamics model is closed; that is, 
all important feedback loops. necessary to 
explain system transformations over time 
are contained jn the mpdel. All system 
actions which can lead to significant 
changes in system conditions shoiild be 
included in the structure, and, similarly, 
all system conditions Vhich can affect 
system actions in important ways should 
be included. 

These fundamental assum'pcions are 
reflected in the detailed fabric of system 
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Jyuamicl> i i iud^li>. lii a muJel, each feed- iiumbei — of -ad 



back loop i§ represented in terms of two 
kinds of variables — levels and rates. 

Level variables (often called state vari- 
ables) represent the conditions of the 
social system at each moment in time. 
Levels describe accumulations of past 
system actions. In an economic model, 
the levels might include the number of^ 
employed and unemployed people in the 
^ftor force and the total Value of produc- 
tive capital. In a schooling model, levels 
migh^ include, among others, the number 
o f a d u l ts-who- have gra d uat e d fr o m college^ 
and the number of high school drqjpouts. 

Rate variables represent the actions in a 
system. In an economic model, for 
example, the hiring and firing rates affect 
the iloW' of individuals from* the un- 
employed and employed. The investment 
and depreciation rates affect th<* level of 
productive capital. In a schooling model, 
the coUe^e^ graduation rate af^cts the 



avr-graduated-^ 



from college. 

Flov\^ diagramming is a convenient v\^ay 
to represent ,the level-rate formulation df 
a feedback loop structure. (See Pugh, 
1970) The example-in figure 2 is a simple 
flov\^ diagram of the high-school enroll- 
ment process. Students enroll, some drop 
out, and others graduate. A rectangle is 
the symbol for a level; a **valve" is the 
symbel for a rate; a directed line indicates 
a flov\^ into or out-of a level, controlled by 
a rate; and a **cl6ud" is the symbol for a 
flow- or i ginating or t ermin ating^ outside 
the system. 

Jt is usually possible to ''disaggregate" a 
single level into several others which 
together make up the original level. For 
example, in figure 2, the enrollment ih 
high school is represented as one level. 
This mieht be decomposed, as in figure 3, 
into emollment in lenth, eleventh, and 
twelfth grades. The appropriate degree of 
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FIGURE 2: School Enrollment Flow Diagram 



128 



124 



disaggregatieii -in— aiTj^^jartkukr- model — - it is-not necessary-tlmt-ieveb-Tepresent 



depends upon the purpose' of the study. 



"countable" physical quantities, like the 
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FIGUKH 3: Disaggregated School Enrollment Flow Diagram 



number of students in school 'or the 
number of classiooms. In figure 4, a 
student's achievement in English (lan- 
guage arts) is represented as a level. Tl^e 
student's learning rate controls the "flow" 
of achievement. Achievement might be 
thought of as the score on a standard 
acliievenient test, and the learning rate 
might"^5^^ the change per year in tlife 
achieyej;nent score. 

kvc information network forms the 
connecting tissue responsible for the self- 
regulating feedback chafracter V of a 
dynamic structure. The informatioiijabri(; 
in a modeji indicates the way in which 



Learning 
Rate 



system conditions, represented^ by the 
Jevel valines, determine system actions, 
represented by the rate values. Informa- 
tion, in a system dynamics model, rifepre- 
sents* the patterns of observation and 
perception on which social actors base 
their actions. For example, the manager 
of a manufacturing plant may use formal 
decision-ruks and data to set prices and to 
order supplies. A teacher may use 
informal observations and knowledge as a 
basis for curriculum preparation. In a 
social system, motivation patterns, social 
norrris, formal laws, money, language, and 
explicitly measured data are all parts of 
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FIGURE4: Student Achievement Flow Diagram' . 
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the ^'information'^ 

The information network is in manv, 
ways the most interesting part of a model. 
Norms, laws, and language are sul?ject to 
many transformations. System conditions 
as perceived by one group of actors may 
be very different from the conditions as 
perceived by another group. Conflicts and 
contradictions in perception can lead to 
important social behavior. 

The flow diagram in Figure 5 illustrates 
mformation in a feedback loop structure. 
In the example, a hypothetical student's 
eamittg-tate-at any ti me is- bas c d u pe^i his- 
perceptions of his level of^achieveme;it. 
As his level of achievement rises, his 



perceived ac hievement rises, his motivation - 
improves, and his learning rate increases. 
According to this simple structure, achieve- 
ment and learnin^^ontiniie to grow 
without tound, for an increase in one is 
followed by ap increase in the other, (This 
is certainly not a complete view of the 
learning process; usually, achievement 
stabilizes and does not grow indefinitely. 
Consequently, other feedback relation- 
ships must be at work which tend to slow 
the learning rate when achievement 
becomes large.) The dotted lines in the 
— diagranv T^resent-ilows-^ inf^rniatiori^-^ 
circle is the symbol fot a component of the 
information network. 
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FIGURE 5: A Feedback Loop in a Simple Student Achievement Model 
The Modeling Process 
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One? a feedback loop structure fought 
explain the behavior of the social 
system under study has been developed, 
the model can be written as a computer 
program. The behavioral consequences of 



the structural model can be ob^^rvedfby 
using the program to simulate the model 
on a computer. A simulation represents 
the "time history'* of a world in which all 
action occurs according to the structure 
of the model. 

often, considerabl-^ experimentation 
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—with uiodcl siiiiu lal iuu ib lequiied in oidei 
to understand the behavior characteristics 
of a model. A complex structure may 
exhibit "steersman .like" directive or goal- 
seeking behavior (termed negative feed- 
back)* A structure may give rise to diver- 
'gence or growth (positive feedback) and .. 
pathologies such as information delays 
and distortion. ''Policies" designed to 
bring about desirable system behavior can 
be tested by altering model structure; in 
niitny cases, experimental pdlicies result in 
"worse-before-better" solutions. 

Te^ t i ng t he:--v^lidity-~of--a >^mulat4an-- 

model is a difficult and ill-un5b«*tei:)d 
problem. A well formulated model creates 
a framework for tlie analysis of data. It 
suggests the kinds of empirical evidence 
required in order to monitor system 
behavior. Moreover, a good model, if it is 
correct, suggests the nature of.the quanti- 
tative and qualitative relatioYiships wjiich 
should' be observed in the data. Models 
are, therefore, important tools in the 
design of a management information 
system. A model can suggest wiiich data 
should 'be collected and how the data 
should be analyzed. 

At the same time, data obtained in a 
systematic information gathering project 
can Help uncover shortcomings in ' a 
model. Errors can emerge in the; original 
conceptualization of a model, in Aio 
particular structural representation, and in 
parameter choices. Models can be im- 
proved through continued logical analysis 
of the model conceptualization and struc- 
Jure and through repeated ciitempts tc) 
compare the- model with empirical evi- 
dence. 

It should perhaps he emphasized that 
there is no one "best" or "final" model. A 
model designed to answer specific ques- 
tions about a system' often tends to 
* generate new questions, and these may 
require the development of new models. 



J ^e modcl- tmilding-proccss ma y re suhritTr- 

a sequence of .models, each related in 
^some way to the others in the sequence, 
but each with a special focus of concern. 
A useful information system must, there- 
fore, be sufficiently flexible that new data 
. can be entered and connected with exist- 
ing data, and existing data can be inter- 
related 4n new ways, 

/ The exi.stence of a model, of course, 
does not insure that it will be employed^ 
by policy-makers. If a model is to be used 
in a government agency, mod^-builders 
— must - take 4nti>—acc(^unt organizational 
context — purposes, structure, and prob- 
lems. The development of organizational 
self-consciousness is the essential and dif- 
ficult beginning of any model-building 
process. Without knowledge of an organi- 
zation's purposes and structure, little 
model usefulness can be expected. 

The goals and structure of an oiiganiza- 
tion as vast and complex as public educa- 
tion in America, however, are not easy to 
ascertain; in fact, the determination of 
the purposes ot American educafTotr^is a 
continuing part of the px)litical process. In 
^ education, poliiries are a result of competi- 
tion among diverse values and interests, 
and it is therefore unlikely that complete 
agreement on a single set of organizational 
goals can be reached. 

Groups with alternative theories and 
values about educaticm ^in America will 
necessarily come to different conclusions 
about policies and practices. Mathematical 
models are not substitutes for a rigorous 
analysis of values. On the contrary, the 
development of useful models in educa- 
tion can come only through intensive 
consideration and judgment of values, 
theory, and evidence. 

The formulation of a system dynamics 
model is consequently a several stage 
process- Edward jR. Roberts carefully 
argues that the entire procedure must be 
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"deliberately and skillfully designed' to 
produce implementable results, the desire 
to implement, and an environment that 
enables implementation." The stages in 
the system dynamics approach as sum- 
marized by Roberts are given below 
(Roberts, 1964): 

1. Piroblem identification 

2. Verbal description of the* dynamic system 
theory affecting the problem 

3. Mathematical model development 

4. Computer simulation of . the represented 
system 

5. Analysis of results to determine model 
validity and factor sensitivity 

6. Double-checking of, and data collection 
regarding, the sensitive areas of the model 

7. Sir^lation experimentation to help identi- 
fy improved system parameters and 
policies ' — , 

8. Implementation oi results of investigation 
in the real-world problem areas 

9. Evaluation of the effectiveness of the 
changes, and return to the first term of the 
procedure for continuing improvement. 

Poverty and Underemployment in 
Massachusetts: an Illustration 

As part of MISOE, a system dynamics 
model of poverty and underemployment 
in Massachusetts is being developed. The 
primary purpose of the model is to 
demonstrate ways in which dynamic' 
systems analysis can aid in education 
policy-making. The model is not yet 
complete, and many issues of empirical 
corroboration and analysis remain to be 
confronted. For this reason, conclusions 
concerning schooling and poverty devel- 
oped from the* model must, at this stage, 
be considered tentative. Nevertheless, the 
model provides insight into the system 
dynamics approach, and it is presented 
here as a case study. 

Poverty, underemployment, and un- 



desirable^ wbrTc~are cbriditio'ns 6f~nra^^ 
social ii^terest and importance. In 1966, 
over 18% of those Americans who wislied 
to work could not find employment, were 
involuntarily only part-time employed, or 
were paid less than $1.68/hpur - the 
hourly equivalent of the $3,500 1966 
poverty line* Fully 33% of those who 
wished to work earned less than $2.65/ 
hour in 1968 — the equivalent of the 
Bureau of Labor Statistics $5,500 Lower 
Level Urban Family Budget (Harrison, 
1972). 

In 1968, the mean earnings for full- 
time workers was $7,320. The mean for 
the top fifth of earners was $15,010, 
however, while that for the bottom fiftji 
was $2,780, Thus, while workers in the 
top fifth earned 205% of the mean, thos ' 
in the bottom fifth earned only 38% 
(Jencks^ 1972). 

Policies designed - to reduce sub- 
employment have beei^ widely debated in 
both academic and political forums. 
Manpower training, educational reform, 
job creation, and urban renewal have all 
been proposed as possible solutions. 

This system dynamics study attempts 
to address two issues: * 

1. What ate the determinants and. 
consequendes of occupational and edu- 
cational stratification in Massachusetts? 

2. To what extent can extreme occupational 
inequalities be reduced by various pur- 
poseful social policies? 

The study has been pursued in the 
belief that extremes of inequality in 
incotne and occupatioiial well-being 
should be reduced. In America, many 
adults face menial work, job instability, 
and' low wages; yet, in America, an 
individual's occupation is a major basis for 
self-respect and political power. For this 
reason, it is essential to understand the 
causes and consequences of occupational 
inequalities and the possible effects of 
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puhiic policies" cfcsigned " to reduce Tif- 
equality. 

In urder to fornuilate *a system 
dynamics model, it is essential to develop 
a precise statement ot the policy problem 
the model is to illuminate: otherwiiie it is 
impossible to judge vv-lnch factors should 
be included' in the mode) and which 
should be omitted. For the study at hand, 
the **dual labor market" theory of 
poverty allows an extremely simple and 
insightful statement of the problem. 

The dual labor market theory, which 
has develt>ped directly from attempts to 
evaluate the ettectiveness of manpower* 
training and anti pcw-rty programs, dis- 
tinguishes two categories of .work, one 
characterized by high productivity and 
high wages, the other by low productivity 
and low wages (Gordon, 1972; Harrison, 
i972; Doeringer, 1972; and Piore, 1969). 
In the primary labor market, high 
wages encourage employee stability and 
investment in training. Stability and train- 
ing permit the ethcient utilization of new 
technologies: and new technologies in 
turn result in high productivity and hi^i 
\vages. In general tiie market power ot 
primar.y iirms leads to high profits, per- 
mitting primary employers to invest both 
in modern capital equipment and, through 
on-the-job training, in the "human 
capital*' of employees. . 

The secondary labor market is char- 
acterized by low productivity, antiquated 
physical capital, low wages, and employee 
instability, .Few skills are required in 
secondary jobs, and consequently, 
secondary jobs attract casual laborers. 

These^ features of the two markets 
create considerable barriers which prevent 
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workers from moX'ing from theTeamctary" 
to the primary economy. Workers in the 
secondary market receive little investment 
in on-the-job training and have httle 
incentive to learn stable job norms. 
Further, employers have come to 'viflue 
certain worker attitudes and demo'gra'philb 
* traits above others. Evidence indicates, foK 
example, that federal manpower training 
programs h'Ave rarely hekn successful in 
placing workers with a history of second- 
ary employment in primary jobs. 

In' the lirban ghetto, the secondary 
labor market competes with ^^quasi-legal" 
activities such as **fiustiing" and illegal 
activity, for example, crime. Both crime 
and secondary employment share qualities 
of instability, risk* and small opportunity 
for ^^advancement." In addition,^ the 
income derived from welfare compares 
favorably with wages in the secondary 
labor marl^et: thus a member of the 
secondary JaUpr force has httle to lose by 
moving from vC^ork to "welfare and back 
again. . 

The balance among primary and 
secondary* jobs in the United States has 
apparently Remained' roughly constant 
since the Second World War, with perhaps 
two-thirds of the labor force in primary 
jobs ajid the remaining one-thir4 in 
secondary employment. Because no 
exphcit categorization of jobs according 
to the two markets has ye^ been 
completed, this estinic^te of relative 
primary arid secondary shares is based on 
^qualitative evidence and information on 
income distribution. 

The dual labor market theory suggests 
the following policy. problem: 

What arc the determinants of therelative sizes 
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of the" primary and secondary labor forces in 

Massachusetts, and to what extent can public 
• policy alter the primary secondary coniposi 

tion of the state's labor market. 
This problem provides a locus tor the 
model-building effort! ^ 

The. most important stage in the 
development of a system dynamics model 
is the formulation of the system structure 
— the set of feedback relationships among 
system actiohs and conditions. In this 
study of poverty and underemployment., 
the system structure should account fo^ 
the observed balance between primary- - 
and secondary jobs in Massachusetts over 
time. 

There are a number of central feedback 
relationships in the two-market system.^ 
The first concerns the prima'ry-secondary 



ji)b"ijataiice iir xhtr-stare -and- thtr-ednca- - 
tional attainment of adults, if educational 
attainment in the state is high, primary 
job growth is stimulated, causing the 
primary-secondary job bajance to mov<^ in 
favor of primary jobs ;» and when the job 
balance favors primary jobs^ highly edu- 
cated people migrate to the state to take 
advantage v>f preferred employment. On 
the other hand, if the educational attain- 
ment in the state is low, primary em- 
pk>yers leave the state to locate elsewhere, 
and the resulting unattractive job balance 
influences ^ttghly ^ucated people to leave 
the state. This is a positive feedback loop 
(see figure*6) because a small increase 
(decrease) in the balance of primary jobs 
leads ^ t'o continuing . future incre?»<:<**J 
(decreases). 
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FIGURE 6: Job Composition-Educational Attainment Feedback Loop 



The second principal feedback relation- 
ship in the system concerhs the educa- 
tional attainment of adults and children. 
When the average educational attainment 
of adults in the state is high, the average 
attainment of their children will be high. 



But the attainment of children in the state 
determines the future attainment of 
adults. Consequently, tliis also is * a 
positive feedback loop (see figure 7). 

The two positive feedback loops dis- 
cussed above would result in sustained 



* A complete description of the theory and evidence on which the model is based and a listing of all 
system equations can be found in Caret, 1973. 
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FIGURE 7: Educational Attainment Feedback Loop 



growth in the fractioii of primary jobs, or 
in sustained decline, were it not for 
several negative loops in the system in- 
volving unemployment and wagco. These 
negative loops tend to preserve a balance 
of about two primary jobs for each 
secondary job in^the state. 

First, consider the wage structure. The 
rate of increase jn the mean wage paid to 
primary job-holders is a function ^of the 



average wage in the state: when average 
wages are high, Iccal xrQsts of goods and 
services tend also to be high, resulting in 
strong wage demands (for example, in 
union negotiations). Since the primary 
wage is considerably higher than the 
secondary wage, the average wage tends to 
increase as the number of primary jobs 
rises, all else remaining constant. Thus an 
increase in the number of primary jobs 
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FIGURE 8: Primary Jobs Feedback I.oop 
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causes -anT increase-in- the average wage, 
resulting in a rise in primary v^ges and a 
corresponding fall in the rate of growth of 
primary jobs, as firms move to t*ake* 
advantage of lower wages in othe»* states. 
This is a negative feedback loop, which 
Jends to preserve the number of primary 
jdbs at a constant level (see figure 8). 
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positive loop relates secondary. 
and ^k^ages: an increase in the 



of secondary jobs 
in the average wage, 



causes a 
which 

in a fall in secondary 
causing an increase in the 
rate of secondary jobs (see 
9). 
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FIGUPJE 9: Secondary Jobs Feedback Loop 



Because primary jobs are usually 
in high productivity, high profit 
industries, primary job growth is generally 
less sensitive to^ wage increase^ than is the 

frrowth of secondary jobs. Thus the positive, 
oop in the secondary wage sector (figure 
9) tends to dominate the negarive loop in 
the primary wage sector (figure 8), and 
the two loops together behave as a single 
positive loop, relating wages and job 
balance. An increase in the primary job 
fraction, increases the average wage, thus 
increasing both primary and secondary 
wages. Since these wage increases tend to 
depress secondary job growth more 
severely than primary job growth, the net 
outcome is an increase in the dominance 
of primary jobs (see figure 10), as well as 
a fall. in the total number of jobs. 



As the total number ^of jobs falls, 
unemployment must rise. Unemployment 
tends to increase the relative supply of 
labor for secondary employment, how- 
ever, and this increase in labor supply . 
results ill a faii in" the secondary wage. A 
decrease in wages, furthermore, tends Lo 
increase the growth rat?^ of secondary 
jobs, increasing the total number ot jobs, 
'^and limiting unemployment. This is a 
negative loop, shown in figure 11. Note 
thajt when secondary wages fall, the pri- S 
mary wage also drops, due to a decHne in 
the average wage. 

A final negative loop relates the size of 
the labor force to unemployment. If 
unemployment rise^, population out- • 
migration from the states tends to in- 
crease, causing the labor force to fall in 
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size, 4ecreasing unemployment, all else 
femaining equal (see figurevl2). 

The overall feedb^ick loop structure u£ 
the dual labor market system in Massa- 



chusetts is represented in a level-rate flow 
diagram in figure 13. All feedback loops 
discussed earlier can be traced explicitly 
in the flow diagram, from the levels-, 
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FIGURE 12; Unemployment Feedback Loop 



through the information network, to the 
rates associated with the levels;\A s%t of- 
equations has been written, corresponding 
to this level rate formulation, and para- 
meter values have been obtained, when 
possible, from census data. The equktion$ 
are expressed in DYNAMO, a computer 
language designed for dynamic simulatio^ 
(Pugh, 1970). 

In the model, the population is, fdr 
simplicity, disaggregated into four age 
groups: 

children (age 0-14) 

.teenagers (age 15-19) 

adults (age 20-64) 
^^-^ag^^dults (age 65 and nver),„^ .... 
This division was selected primarily be- 
cause labor force participation, fertility 
and migration characteristics differ 
significantly among the groups. In fact, of 
course^ the groups are not completely 
homogeneous with respect to these char- 
acteristics; for example, women arp mor^l 



likely to l^ear children in the age period 
20-44 than in the period 45-64. 

The adult and aging adult population is^ 
'disaggregated into five educational attain- 
ment groups: 

highschool dropouts (0-11 years completed) 
highschool graduates (12 years completed) 
; occupational education graduates (12 years 
completed) 
some college (1345 years completed) 
college graduates (16 or more years com- 
pleted) 

Children and . teenagers are grouped 
according to the educational attainment 
of the he^d-of-household of their family 

of origin. . _ 

In the flow diagram (figure 13), the 
large rectangles labelled "Children" and 
"Adults'* e§Lch represent a set of level 
variables in the model. The large "valve" 
symbols represent related sets of rate 
variables. 
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; The present Version o£ the model in- 
cludes four job markets: 

primary manufactunng jobs * 

primary service jobs , 

secondary manufacturing jobs 

secondary service 'jobs 
In the flow diaCgram, the large rectangle 
labelled '*Jobs" represents the set of four 
job level variables, and the valve symbol 
represents related rate variables. 

To • each job market category in thp 
model corresponds a v^age level, and the 
set of four wagei is represented in the 
diagram by the jlarge rectangle labelled 
"Wages,"' The large "valve" represents 
— relatednwage-eh^ge^ate-variables^^ 

Each feedback structure in the model is 
represented as a closed loop formed of at 
least bne le^el, an associated rate, ahd the 
informationVnetwork cdnnecting them. As 
an example, me feedback loop shown in 
figure. 6, relating educational attainment 
and job composition, can be traced in the 
general flow diagram beginning with the 
"Jobs" level variables. The loop continues 
from the "Jobs" levels through the 
"Occupational Status" and "Relative 
Occupational Status" information auxil- 
iaries, to the "Migration of Ad,ults" rate 
variables. In the model, the "Occupational 
Status" auxiliary represents the occupa- 
tional quality of the state, in terms of the 
primafy-secon4ary job balance; "Relative 
Occupational Status" represents the job 
quality in fhe state relative to the average 
in the JJnited States as a whole. The 
feedback loop continues through the 
"Adults" level variables and the "Labor 
Forc^, " "Ed ucational 
and "Relative Educational Attractiveness" 
auxiliaries, Th^ "Labor Force" auxiliaries 
represent the numbers of people with 
different amounts of education^ partici- 
pating in the labor force. The "Educa- 
tional Attractiveness" variables are indi- 
cators of the degree to which the ^^U^, 



training and attitudes of members .of the 
labor force, 'as reflected in their educa- 
tional attainment, correspond to those 
desired by employers. Finally, the feed- 
back loop continues from the "Rekjative 
Educational Attractiveness" auxiliaries, tq 
the "Gr(5wth in Jobs" rates, returning to 
the "Jobs" levels. Thus, the loop is closed. 
Job composition affects occupational 
status, which influences migration, alter- 
ing the educational attainment of adults. 
.The attainment of adults influences the 
educational attractiveness of the labor 
force, which in turn determines job 
growth, affecting job composition. The 
feedback- relationships shown in figures 7 
through 12 can be traced in the flow 
diagram similarly. 

The purpose of formulating i mathe- 
n^tical model is to gain understanding of 
the behavior associated with a structure. 
This model of the two labor market 
system in Massachusetts generates a forty 
year time history. During the simulation, 
the period' 1960-2000 is traversed in 
one-year intervals, beginning with given 
initial conditions. The values of the 
system levels at the beginning^ of an 
interval determine thie values taken^^^by the 
system rates during the' interval The 
values of the rates during one intes^^aifin 
turn, determine the changes in the values 
of the levels from that interval to the 
next. It should be emphasized once again 
that all changes in system levels are 
determined by rates, and that all rates are 
determined by system levels: the model is 
"self-regulating," v 

-Gusves^ in th e fig itfes- which f oHew^- 
were , prepared from computer plots 
, showing the behavior of selected system 
variables as generated through time by the 
simulation model. The horizontal axis is a 
time scale, starting with the year 1960 
and continuing for the next forty years. 
.The vertical scales at the left of each plot 
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are marked at the top with the plottmg 
symbols to which they apply. 

The computer plots for the 'staQdard 
model simulation are given in figures 14 
and 15. The behavior is rather straight- 
forward: primary and secondary jobs rise 
throughout the 40 year period, maintain? 
ing their relative shares of the labor 
market. The population grows at a slo>v- 
ing rate. The relative wage, educational 
attractiveness, aiid occupational status 
variables all persist approximately equal 
to unity, and the unemployment rate falls 
slightly. 



This fall in unemployment rate is due 
to the population miration formulation. 
As the empirical evidence indicates, there 
is a net out-migratiqfn from states ex- 
periencing unemployrr^ent rates equal to 
the national mean. The initial 1960 
unemf>loyment rate in Massachusetts was 
set »equal to .05 in the model, and it drifts,* 
down to about .04 as the out-migration 
diminishes the size of the labor forcp- The 
small variations in the relative W^es ar^ 
due to these changes in the un- 
employment rate (see the feedback stfi^jic- 
ture in figure 11). . J 
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nCURE 14: Standwd Model Simulation 
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FIGURE 15: Standard Model Simulation 



The standard run is, of coursie, unsur- 
prising — tKe model was constructed in 
such a way that the primary and 
secondary markets grow evenly. 

Several model experiments have been 
conducted, by altering the normal growth 
rate parameters of one job sector so that 
the normal primary and secondary growth 
rates are no longer equal. Compensating 
changes in unemployment, wages, ana 
population migration (see the Feedback 
loops in figures 11 and 12), however, tend 
over time to^oiinteract the alterations in 
normd' growth rate Altogether, "the re- 
sults of these experiments are not too 
different from the basic run — indicating 
that a rather substantial change in the 
normal primary or secondary job growth 
rates does not have a very significant 
effect on the characteristics of the labor 
market/ 



The model can be used to test the 
effects of experimental policies on labor 
market composition. The first policy 
tested is an occupational education pro- 
gram . which provides one-third of the 
normal high school dropouts with an 
occupational school educsltion each year. 
This, of course, would be a difficult and 
perhaps costly program to implement; for 
purposes of this test, however, it is 
assumed that the program is implemented 
in 1965 and that it is effective in pro- 
vidi ng p otential drop outs^ with an occupa- 
tional school ecjjlcation. 

As figures 16 and 17 indicate, the 
program has a significant but not dramatic 
beneficial effec^t on labor market compo- 
sition. By the year 20CrO, the primary job 
share has risen from 66% to 74%, and the 
secondary share has fallen , froni 33% to 
26%- Interestingly, the program has 
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FIGURE 16; Occupational Education Policy Test 
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FIGURE 17: Occupational Education Policy Test 
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almost no effect on job composition 
whatever until 1974, nearly ten years 
after ^t is implemented, arid it has no real 
effect until the late 1980's. TMs is due to 
the fact that the educational attractive- 
ness of the poptdation influences the 
number of primary jobs through the rate 
of primary job growth. An improved 
primary job growth rate must persist for 
quite a few years before the increase is 
• felt as a significant change in the primary- 
secondary job balance. 

It is also interesting that the total 
population in the experiment gro\Vs to 
over 7 million by the year 2000 — a figure 
over 500,000 greater than the total in the 
standard run. This is due to the improved 



relative occupational status and* favorable 
unemployment rate (see the feedbacks- 
loops rt\ figures 6 and 12). The possibf^^ 
detrimental effects of crowding are nat^ 
included in this model; any consideration 
of social policy, however,^ would have to 
take such effects into a^erSunt. 

The outcome of t\it occupational edu- 
cation experiment suggests that a favor- 
able policy might also require direct inter- 
vention in the. labor market, in an effort 
to work with employers and workers, 
tj|rough on-the-job training and re- 
organization of work, to convert 
secondary to primary jobs. This policy has 
been proposed by a number of dual 
market theorists. The policy has been 
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FIGURE 18: Job Program PoUcy Test 
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FIGURE 19: Job Program Policy Test 



tested in tlie model by moving 3% per 
year of the jobs in the secondary sector to 
the primary sector, beginning in 1965. 
This would \yy doubt oe an extremely 
difficult poUcy to implement. Here, a test 
is made of such a policy's effects on the 
assumption that it can be successfully 
carried out. Figures 18 and 19 indicate 
the results of the experiment. 

As can be seen, by the year 2000, the 
job share of the primary market is about 
90%, while that of the secondary market 
is about 10%. This is indeed a dramatic 
improvement. The unemployment rate 
rises somewhat in the process, and this has 
the effect of reducing the population 



in-rmigration that would otherwise occur 
due to the improved occupational situa- 
tion. The improved occupational status 
does increase the in-migration of highly 
educated adults, which enhances the rela- 
tive attractiveness of the labor force to 
primary employers, somewhat compen- 
sating for the rise in wages which is the 
CO hseque nee" of the chahgtrig job mix (see 
the feedback loops in figures 6 and 9). 
< A final policy experiment combines a 
1% per year direct conversion of 
secondary to primary jobs with the occu- 
pational education program discussed 
earlier. The results are indicated in figures 
20 and 21. 
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These policy tests should be considered 
as- model . experiments.. They are not 
recommendations for action. At this 
stage, the model is a laboratory in which 
hypotheses can be tested. Many model 
experiments must be evaluated; evidence 
must be compared with model behavior; 
important parameters must be revised to 
conform more nearly to the developing 
empirical theory. These are matters con- 
sidered in the concluding section of this 
chapter* 

System Dynamics and Management Infor- 
mation Systems 

John Little writes that, **the big problem 
with management science models is that 
managers pract;ically never use them" 
{Little, 1970). Political rationality and 
responsibility in education are not served 
by the production of data few jpeople use 
or the development of models few people 
understand. To be used^ infbrmation 
should meet the kinds of criteria Wilensky 
has su^ested: it must be clear,^ timely, 
reliable, valid, adequate, and wide-ranging. 

The development of information witjj 
these qualities is necessarily an evolu- 
tionary process. The particular evidence 
collected for an information system — the 
variables measured, the instruments used, 
the errors tolerated — will depend upon 
the values and theories held by the investi- 
gators. To the extent that these values are 
unexamined or the theories are incom- 
plete or ill-formed, the evidence collected 
\vill likely suffer .from empirical and 
conceptual inadequacies; it will be un- 
clear, untimely, unreliable and invalid. 

In shorty empirical evidence, if it is to 
be used^ as a scientific base for decisions, 
must be- collected with a clear human 
purpose in mind. The formulation of 
dynamic system models is one way to 
attempt to make values and theories 



explicit: In developing a model, assump- 
tions are often clarified, and the con- 
sequences of multiple assumptions, taken 
together, can be examined. 

of course, a models once formulated, 
must be compared with the- evidence 
provided by the "concrete*' system under 
study. Thus a model suggests not only 
what should be measured, but also what 
should be expected in the data collected. 
As data is observed, of course, models will 
necessarily be altered and new sources of 
evidence will be demanded. 

The labor market model described 
above focuses attention on issues for 
which new evidence is required: for 
example, to what extent is job growth in a 
state sensitive to the educational compo- 
sition of the labor force? To what extent 
is population migration sensitive to occu- 
pational status? How important are wages 
in industrial location? Some evidence is 
available to, answer these questions, but 
more information is needed. 

The primary value of a dynamic model, 
such as the labor market model discussed 
earlier, does not lie in the precise policy 
recommendations' which emerge. Most^im- 
portant isf the model formulation process 
itself, which provides a means of visualiz- 
ing actions and their interrelations in a 
complex system. Long term consequences 
of actions and unexpected secondary 
effects gain clarity when viewed in a 
system simulation context. Further, the 
possibility of real and difficult value 
choices is often suggested in a system 
study. For example, in'tlie laborjparket 
model, it appears tnat policies wEich 
improve the primary-secondary job com- 
position of a state ipay, at the same time, 
increase the unemployment rate. 

Amital Etzioni has argued that the 
important issue 'in social action is similar 
to the dilemma posed by Freud in in- 
dividual conduct: how is scTciety guided 
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and what activities extend or curtail 
societal self-control (Etzioni, 1968). 
The study of social policy in 
dynamic syjitcm terms is directed 
toward an increased understanding 



of the social guidance process. 
Perhaps the use of dynamic systems 
analysis is also a program in the 
. direction of- a new social self- 
. consciousness. ; <- — - 
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CHAPTER 10 
^u' AN ASSESSMENT OF MISOE 



The assessment responses by Charles H. Buzzelly David, V. Tiedenum and Jacob J, 
Kaufman are offered to provide the reader with reference points for detennining the 
lisefuhiess of MISOE, Each iissessor responds from a professional perspective: Ihizzell as 
a chief state .manager for occupational education in Massachusetts; Tiedenum as an 
educational researcher and Kaufman iis aii economist. It was the editorial intenUon to 
provide a range of responses as a stimulus for a broad-based evaluation. To a large extent, 
tlni seems to liave been accomplished, Charles BuzzelVs piece rings of "binder the gun' ^ 
management realities^ Dave Tiedeman's discussion deals with scope^ structure and value 
and Jack Kaiifman's assessment sounds just like an economist^ iv; it shouhL Vogetlier, 
these responses cotdd be helpjid to the reader who has surrendered some of his 
nonreplaceal^le time to consider and judge MISOE,- 
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A MANAGER'S RESPONSE TO MISOE 



7 



Cluarles H. Buzzell 
i Associate Commissioner 
Divisii)n of Occupational Education 
Massacliusetts Department of Education 



When one reviews the "state of the art" 
relative tq rational decision-making by 
educational managers, it should become 
obvious why MISOE has captured the 
imagination of administrators not only in 
Massachusetts, but nationwide. There lies 
within this highly complex»and scientific 
information system the potential of free- 
ing educational managers from the 



ment strategy which is based upon 
emotional pleas for increased tax dollars 
to "help children." This tactic will no 
longer suffice. 

The level of taxpayer concern (the 
essential em{)loyer of educators) has 
reached such; a crescendo in many places 
that it has triggered direct responses by 
legislative bodies, rather th^n educators. 



harards of making budget and j>rogram*— — rAs^^rese Hresponses develop, tlie real 



matic decisions in a veritable vt^cuum, too 
ofteii^evoid of valid data. To liam^ the 
full potential of MISOE requires a new 
level of decision-tnaking sophistication be 
achieved. This sophistication is not an 
exercise to become academically "hip", 
but, rather involves the development of 
important new skills and understandings. 
The need for improved management tech- 
niques is a clear alternative to a manage- 



Sanger of noneducators assuming the pro- 
fessional educator's role becomes a reality 
which may have dire consequences tor 
professionals. In short, MISOE is a 
necessity in the face of this reality, not 
just another "academic'" exercise. v 

Accountability," that much bandied 
about expression, is upon us. lather than 
placidly sitting back, in the \ppes of 
seeing it fade away, managers who recog- 
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nizt* the importance of the ctmcopt are in 
a pro-active stance, gathering their forces 
in order tc* be in the vanguard ot educa- 
tional response to tlie cry tor accounta 
bihty. 

MISOE provides administrators with a 
rational system for the implementation oi 
an accountability process. Fundanientally, 
it addresses ' itself, to the subst<uitive 
question of; giveiCliniited resources and 
unlimited demandsNhow can I make 
decisions which willj resAilt in resource 
allocations achievingl maximum cost/ 
•benefit ratios? * \ 

In Massachusetts, ''which has some 
325,000 secondary students, more than 
Ifl 90,000,000 is spent annually on occu- 
pational education. It is the efiicient 
distributioiv of these funds in a way to 
maximize benefits to society and students 
that constitutes the core of MISOE's 
contribution to rational management, c 

In a society composed of a variety ot 
sub-systems c<nnpeting for essentially the 
same dollars, the success or failure ot the 
educational sub-system will rise or fall on 
the results of the decisions educational 
managers make. These decisions will not 
only affect education, but upon imple- 
Vjmentation, can affect other political and 
^^^^omic sub-systems. In this light, the 
%ue^rint of MISOE has incalculable 
valuei It should be stressed, however, that 
MISOE can be effective as a tool for 
management only if it functions in a close 
relationship with the local educational 
agency, the State Department of Educa- 
tion, and appropriate legislative and fiscal 
bodies. 

Impact Staternents 

Given MISOE as a system to assist in 
decision-making, the manager is able to 
relate input to prc^duct, as well as to 
impact. For sc^ne it is essential in 



decision-making not to focus on product 
statements, but impact statements. Let us 
presume that education wishes to con- 
tribute its share to increasing the tax 
revenue available to the state. It might be 
assumed that increased occupational 
education could lead to increased state 
revenue by virtue of increasing the tax 
base. 

In an attempt to achieve this goal, the 
occupational educational manager - must 
determine wliere to distribute his dollars.* 
He may choose to invest in one or more 
of the following in^)rder to maximize his 
benefits, i»e., increase the tax base, ex- 
pand facilities, expand and/or • improve 
curriculum, focus on professional 
improvement (pre-service, in-service), 
expand remedial^ skitis in " f he academic 
sector. 

However, more often than not he linds 
that the data on which he bases his 
allocatibn(s) are incomplete, without 
validity or reliability. Just where among 
the competing alternatives does he allb- 
cate money? One thing is certain, he will 
allocate. Often in the absence of fact he 
relies on "gut" feelings. He may have a 
"feeling" for wliat is best, but he does not 
kmnv what is best. 

Hypothetically, ' a manager may feel 
that the key to increasing the tax base lies 
in enticing new industry into the state, 
using the lure of a skilled .work force 
which could be trained. An hidustry may 
be a logical choice betfause manpower 
opportunities are high and the training 
costs low. However, this decision, bas^d 
cm lack of sufficient data, could have long 
range effects counter-productive to the 
goal of increasing tiie tax base. For 
instance, new industry and employment 
prospects may cause an increase in migra- 
tory flow from other locahties. In essence, 
the pay off of dollars invested in occupa- 
tional education may be jeopardized by 
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an outsidt% experienced vrark force which 
supplants local lah(|)r^jryaddition, greater 
burdens- may c^lso be placed upon the 
state, city, and/or town tor supple- 
mentary services (poHce, fire, education, 
sanitation, highways, etc.) by the new 
industry, as well as by the new population 
group. Thus, the demand for service 
dollars may far exceed the new tax dollars 
produced by the industry. 

Hence-, in the absence ot sufficient 
information, what appears logical to a 
manager can be -subverted by previously 
unconsidered variables. Without a relevant 
management system/ using only the data 
and tools presently available, the educa- 
tipnal manager cannot accurately estimate 
present program benefits or the far reach- 
ing effects of his decision on other sys- 
tems. The occupational education 
^manager needs a process to help him 
^measure what he received for past per- 
formance, and therefore a more .accurate 
measure of what alternatives are open to. 
him now. MISOE can provide this 
process. MISOF can, relate to managers, 
not only information, but alternatives for 
action, their variations, ' and possible 
consequences. 

However, it must be emphatically - 
stressed that MISOE will not mdke a 
decision for a manager. MISOE must not 
be looked upon as a substitute for the 
decision-making process. It can only dis- 
play alternatives for us, as any manage- 
ment system can. MISOE cannot act 
alone, it is man who humanizes and 
interprets for implementation. This 
personalized conception is vital; he is 
ultimately the decision-making process. 
Admittedly, we do not as yet have all 
elements isolated or factored outr. But we 
do have, with MISOE, more than we have 
currently. MISOE will also enable us to 
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take a great percentage of the risk out of 
^our deci&ion-making. 

Uvulucition 

To test the validity of MISOE, its 
concepts were arrayed before a group of 
state and federal administrators at varying . 
levels of the occupational education 
hierarchy.^ General concensus of opinion 
was that MISOE can n>ake a valuable . 
contribution to education, and in turn, to 
society as a whole. 

The evaluators supported the^notion of 
expanding the current state of the art in 
makinjg rational decisions from competing 
alternatives. However, they also stressed 
the need for implementation taptics. 
MISOE will deliver its'benefits to a variety 
of sectors, but these sectors must know 
their benefits as well as their responsibili- 
ties. It is crucial that manager^ uiiderstand 
that benefits can only result from their 
input. 

With this beginning, MISOE begins Phase 
II. We are now taking the blueprint off the 
drawing board and fabricating the tactical 
strategies to implement it., We would hope 
that the strategies resultant from Phase II 
will help realize decisions which are more 
cost beneficial. 

Only when these strategies can be proven 
successful by MISQE will educators begin 
to relinquish the ambiguities, and 
ambivalence of the past, and begin to 
assume the posture which is theirs, a 
posture v/hich will , allow them to come 
forth and present to "the essential em- 
ployer" the kj.nds of budgetary and pro- 
grammatic decisions which that employer 
is demanding.! V 

The tool, MISOE, is in place. What is 
needed now il the determination to pick up 
that tool anl use it to its fullest potential. 
Frankly, education has no choice. 



^Scc appendix, this chapter 
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The following is a list of people who attended the National Invitational conference of 
September 13 and 14, 1973 to offer judgment upon MISOE. 
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Room 219 ^ 
175 W. Wieuca R'bad, N.E. 
Atlanta, Georgia 30305 ' 

Miss Batbara Carraway, 
Division of Occupational Education 
Department of Public Instruction ^ 
Ralifigh. North Carolina 2761 1 

Dr. John A. Creager 
Research Associate 
Office of Research 
American Cbuncil on Education 
One DuPont Circle 
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Dr. Ernest Feleppa ^ 
Division of Occupational Education Planning 
99 Washington Avenue 
Albany, New York 12210 

Mrs. Ernestine H. Frazier - 
Asst. Dir. Program Evaluation 
Division of Occupationial Education 
Department of Public Instruction 
• Raleigh, North Carolina 27611 

Dr. Jack Gutilla 
Vocational Education 
Room 612, Ohio Departments Building 
65 South Front Street 
Columbus, Ohio 43215 

Dr. Howard Hjelm 

Adult, Vocational & Technical Education 
Deportment of Health, Education & Welfare 
Office of Education 
Washington, D.C. 

Dr. Jacob J. Kaufman 
Director & Professor of Economics 
Pennsylvania State University 
Institute for Research on Human Resources 
407 Graduate Building 
University Park, Pennsylvania 16802 

Dr. Michael Kozma, Supervisor 
Division of Occupational Education Planning 
State Education Department 
99 Washington Avenue 
Albany, New York 12210 



Dr. Charles J. Law, Jr., State Director 
Division of Occupational Education 
Department of Public Instruction 
Raleigh, North Carolina 27611 

Mrs. Mae E. Murphy, Consultant 
Program Evaluation 
Division of Occupational Education 
Department of Public Instruction 
Raleigh, North Carolina 27611 ^ 

Dr. Urwin RoWntree, Director 
Adult, Vocational & Technical Education 
Room 1309-A ^ , 

J. F. Kennedy Federal Building 
Boston, Massachusetts 02203 

Mr. Robefrt Russell, Director 
Chief of Data Processings Vocational Division 
" :'^225"Wesr^£are Srreer~ - ^ ~ ~ 

Trenton, New Jersey 08625 

Mr. Harold Seltzer, Director , 
. Occupational Research & Development 
225 West State Street 
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A Model of MlSOU's Past Growth 

I had the pleasure of advising the 
Associate Commissioner, Division of 
Occupational lEducation, Commonwealth 
of Massachusetts to support constructioh 
of MISOE (Management Information*' 
System for Occupational Information) 
when, in the Spring of ' 1971, he was 
entertainuig a proposal for its inception. I 
considered the potential value of MISOE 
to be evident even during inseminjttion. 

*As MISOE entered the gestation of 
implerricntative planning in the ensuing 28 
months, Dr* Wilhani Conroy kept the 
promise of MI^OE*s potential before me 
by reporting to me and consulting me 
from time to time. I was first pleased with 
Dr. Conroy's vision of the many uses and 
users of MISOE. Dr. Conroy dreamed 
large dreams for the child he was con- 
ceiving. I was next particularly delighted 
by his choice in that dream to have the 
acronym MISOE represent a Management, 



not just a Massachusetts Information 
System for Occupational Education. 
Although the samples, which would 
a^^tiially go into a MISOE supported by 
the Commonwealth's Associate Commis- 
sioner for Occupational Education would 
be those dictatec^ by the boundaries of his 
■j Commonwealth and specific duties, 
MISOE's conception is as applicable to 
Massachusetts' 49 sister states as it is to 
herself. 

The MISOE is in one sense born with 
publication of this J onrnaL MISOE's 
implementative planning is concluded. 
The child is born. It remains for those 
who must decide either to accept and 
nurture or to reject and ignore the MISOE 
to determine whether this baby wHl have 
a childhood or not. I personally hope that 
the baby will be given a childhood. The 
baby is born healthy. The potential of the 
baby is great, just as its promise was in 
Spring, 1971. It currently remains for 
those of us who will benefit from its 
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adulthood to decide to invest th^ money 
still needed to give it a childhood. Hence, 
it's important tor us who have read what 
MISOE can be about to pause now and 
assess whether we wish to help it achieve 
its potential or not. 

Reckoning What MISOE Currently Is 

The reader is cautioned that MISOE 
presently exists only in potential, not in 
reality » Like the baby it is, JN^ISOE is a 
corpus, capable of existence with further 
nurturing, but doomed to death without 
developmental financial nurturance in its ' 
immediate future. The articles provided 
by Dr. Conroy and his staff mdifate in 
f^yqinqire rifffafi what 'MI^^^Ot^ ^atN^O 



provided someone is now willing to inv^t^ f; 
in the data assembly and data analyses 
which are required to turn proposed, 
adjuvant, interactive-computational form 
into the needed reality. Dr. Conro^ and 
his staff have taken all the steps needed to 
give the Commoiifwealth of Massachusetts 
the following capability: 

1. A fcnsus of a few data for all schools 
including those offering occupational edu- 
cation within the Commc^nwealth (only 
very broad data will be collected in the 
census, bat the census defines the popula- 
tion of schools which wiU be represented 
in the sample of schools); 

2. - Representative samples of schook which, 

because pT the fine detail of their data, will 
permit extensive IPPI (input, process, 
. product and impact) studies of occupa-, 
tional educ;^ion in the Commonwealth of 
9. Massachusetts and its contrast with non- 
occupational education; 

3. Cost data which will permit IPPI studies of 
Occupational and non-occupational educa- 
tion to be undertaken with full attentioiji 
to costs, benefits and relative effective nessjy 
and , r) 

4. An extremely powerful interactive compu-i 



tational system which ^ves a user flexibk 
specification of (a) target groups, (b) the 
analyses he wants performed, and (c) the 
formats in which he wants his data 
reported. 

In addition, Ms. Weinberger, Dn 
Conroy and Mr. Garet hav'e illustrated the 
versatility of the adjuvant, interactive 
computational facility which MISOE can 
be. Ms. Weinberger has given several rather 
clever examples of reports which an 
administrator will be able to get from an 
operating MISOE. Any administrator with 
technical leanings could not help but 
admire the reporting power which MISOE 
could put at his command. ^ 

.Dr. Conroy went on and presented an 
^ Ad vanced example of how an administrator 
can locate a problem among the data of his 
reports and cleverly query the system in 
carder to find a path more likely to achieve 
wha* he wants vnthin costs more reason^ 
al^^Le for*^the elected procedure than for 
others. An educational reseafther cajjnot 
help but admire the scientific method and 
technique which Dr. Conroy exemplified.^ 
MISOE invites administrators and policy 
makers to be applied scientists of the^t 
of managing occupational education. 

Finally, Mr. Garet has illustrated the 
quite considerable power which is envi- 
sioned tor MISOE, namely inclusion of 
Forester's system of dynamic analysis. 
Dynamic analysis is not common in ejlu- 
cational research or policy making and 
deserves a few extra words as a result. 
Most of what is investigated in educa- 
tional research and policy making occurs 
within fairly closed and a priori systems. 
The result is that most of our investiga- 
tions are more convergent than divergent. 
We lack inclination toward divergent 
thinking and its rewards of discovery. Yet 
we are day by day, year by year, gaining 
more evidence that more divergent than 
convergent thinking is needed in educa- 



t)0 



152 



tion. Old assumptions need tlie revitializa- 
tion of new assumptions, as it day by day 
becomes more and more evident tliat old 
solutions are not up to new demands in 
education. Dynamic analysis offers 
visionary administrators the power to 
think divergently with a system that 
converges in its limits. This povs/er stems 
from the fact that the administrator has 
to operate on his variables in dynamic 
analysis in order to move effects , from a 
state which is not desired into another 
state which is desired'. This requires that 
the admhiistrator not alone thirtk rela- 
tionally as those of us in educational 
research have so far taught him to do, he 
must think functionalists well. He mus^ 
chain effe^cts into sub-systemsv m wTucTi a 
causes h and b causes c, etc. Means lead to 
ends but in the end the administrator will 
find that in reality one end merely 
becomes the means to a larger end, etc. 
Furthermore, he must begin to estimate 
rates in order to see how long it will take 
a to becorne h, etc., under his assump- 
tions. Administrators who allow, them- 
selves time to become familiar with such 
technique and thinking will find that they 
can chart quite considerable pathways 
into the future with quite strong feehngs 
that they know what is likely to happen 
within relatively narrow time spans, pro- 
vided ce'rtain conditions can be made to 
exist. The effects which MISOE seek to 
cause in administrators would allow them 
to play with its* capa*bility for dynamic 
analysis in the same, way which an 
insurance agent trys to influence his 
customers, namely to look into the future 
and its potential, relatively certain that- 
consequences which are sufficiently 
detailed and clear will give tlie customer 
the personal conviction that he must act 
now, in such and such ways, to get what 
he seeks by "x" years from now. Dynamic 
analysis can build the consciences of 



occupational education's administmtors 
to such a point that they become more 
rational guides, not the somewhat . irra- 
tional guides they are, and will remain, in 
the absence of dynamic analysis in 
MiSOE. - ^ 

- Although I intentionally accord MISOE 
great potential, I am realist enough to 
anticipate problems for MISOE as well. In 
order for MISOE to work, it must have 
data, not enormous sets of missing obser- 
vations. It must be open to all users, not 
closed to many users. It must be consulta- 
tive, not dictatorial* It must be syner- 
gistic, not competitive. Such conditions 
will not easily materialize. Some of the 
difficulties now readily discernible are as 

T6nowsi 

1. Local schools and the Commonwealtji's 
Department of Education itself must all 
agree to participate in MISOE for it to 
work; 

2. There are rather high implenientative costs 
which must be borne to collect MISOE's 
data, maintain its data files, and operate it 
as a consultative, adjuvant, interactive- 
computational facility; 

3. There are computational and display dif- 
ficulties of high magnitude which must be 
worked through before the adjuvant, inter- 
active-computational facility will become 
as commonplace and reliafcle as the tele- 
phone; and 

4. The difficulties which naive users will at 
first experience will cause the near sighted 
to argue that a state facility ought to do 
the computation for a user, not provide 
the adjuvant, interactive. Computational- 
capacity in which any Torn, Dick and 
Harry who thinks he can-' decide better 
than a legislator, the CommonwealtVs 
Associate Commissioner for Occupational 
Education, or a local system's director of 
occupational education can act"any test 
his assumptions. 
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Aitematwes and a Recommendation 

Since MISOE is' funded annually, its 
continuaobn or discontinuation will be 
the major decision which has to be* 
reached now that implementative plan- 
ning is almost finished and implementa- 
tion itself is becoming necessary, if the 
planning .is to be given value. In this 
decision, immediate full or ^ phased 
implementation are alternative pathways 
wlach can be followed, should implemen- 
tation be elected* My recommendation is 
by all means for implementation, but I 
suggest a phased rather than w immediate 
full implementation. Why? 

Llij^tkl^A^k.^. for^ Reco himendat i o n of a 
^ Pfuised Implementation 

Readers experienced in operating data' 
files within the context of an adjuvant, 
interactive, computational capability can 
readily understand why I recommend a 
phased implementation of the MISOE. At 
the present time MISOE's data files do 
not exist, except 'as examples. In addition, 
MISOE's c<>mputational routines appear 
so far to have been exercised merely in 
terms of the examples repotted by Ms. 
Weinberger, Dr. Cbnroy and Mr.' Caret 
above. Actual data and computational 
routines have yet to meet each other. 
Those experienced with computer -opera- 
tion<^know that many difficult hours lie 
ahead for those who would make an 
adjuvant, interactive, computational- 
facility out of that meeting. There is a 
need for as yet unwritten editing routines 
for both the data files and the* output 
programs. Despite such programs, inevit- 
able errors in data files and output rou- 
tines creep through even the most rigorous 
editing routines and will cause difficulties 
for awhile. Intermediate applications 
programs" will be needed to approximate 



optimization of data recovery and i^se in 
the various forms of problems which will 
be attacked. In addition, educational 
researchers and educational policy makers 
are not very experienced in asking 
product and impact questions simultan- 
eously in a system^ of input and process 
data as well. 'Experience will therefore 
have to emerge in the handling of cost 
data in relation to output data. These 
conditions together suggest that at least 
12 months of intensive trial effort in the 
operation of the adjuvant, interactive, 
computational-faciltiy will be necessary. 

Although the need Tor more trial and 
experience with the operation of son inter- 

.active computational^ facility seems self 
evident at this time^ it is still necessaryJo _ 
make a positive overall implementation 
decision at this time. The big problem for 
MISOE is -initiation of its data file. This 
requires the Division of Occupational 
Education in the Commonwealth of 
Massachusetts resolutely to djrect 'acquisi- 
tions of the data called for in MISOE's 

'detailed implementative plan. Both local 
school systems and the Commonweakli's 
Department of Education itself will be 
sources of the required data. Hence co- 
operation of these groups will be needed 
and should be obtained as early ^as pos- 
sible in coordination with the further 
development of the adjuvant, interactive, 
computational-facility. There will be no 
reason for the latter in the absence of the 
former. 

The genius of the MISOE plan lies in 
the expectation that it will operate as a 
network. Data are to be assembled at local 
and Commonv^ealth levels. Computational 
power is being arranged to address ques- 
tions in local program invention and 
"operation, in Commonwealth program 
invention and operation and in legislative 
pohcy making. There are fortunately no 
present plans to restrict address of any 
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part of tlie system to any class Sf user. 
This means that in addition to the ques- 
tions appropriate to the level at which 
each works, local program administrators 
can ask Commonwealth and legislative 
questions, Commonwealth administrators 
can ask local and legislative questions, and 
legislators can ask local and Common- 
wealth questions. In contradistmction to 
present suspicions which currently limit 
each group to the questions at only its 
own level, MISOE can therefore 
materially increase communication and 
understanding among local and Common- 
wealth administrators and legislators. 
Through MISOE each can satisfy himself 
that the other is doing the best he can or 
«lse ^nerate ^ata publicly -tran^missaUe ^ 
which ought to convince the party in need 
of change 'of the bases on which that 
change ought to be predicated and pur- 
sued. 

The creation and operation of a net- , 
work requires leadership and finesse. 
MISOE as a network intends to operate as 
a consortium* Funds will have to come 
from both local and Commonwealth 
sources for data collection, filing and 
analysis and for the continual consulta- 
tion with users which is required in 
operation of an adjuvant, interactive, 
computational-facility. The Federal gov- 
ernment, additionally, has to be interested 
in ^generalizing MISOE to the several United 
Stiates, thereby creating a fourth level at 
which *MISO^ can operate. However, 
Federal participation should not be ex- 
pected other than in development at the 
moment. The Commonwealth and its 
local systems will have* to hft themselves 
by their own ^.bootstraps in the actual 
operation of their consortium for awhile 
before the Feds are likely to become 
convinced that MISOE is a good valuable 
to Massachusetts' sister states as well. 

With annual renewal of funding being 



the momentary situation, the Division 
Occupational Education has to address 
the problem of leadership in MISOE with 
considerable care. Effective and efficient 

. operation of MISOE requires the ability, 
interest and dedication currently 
exhibited by those who conceived and 
planned it. However, personnel of s^uch 
quality are not hkely to remain interested 
in a project in which the Commonwealth 
annually wavers in its support. Hence the 
present key to MISOE's childhood prin- 
cipally rests with the Divisi6n of Occupa- 
tional Education and its resolve to^press 
forward, despite the difficulties which can 
now be foreseen and Will inevitably arise, 
even though all are not now foreseen. 

The. Division -4:>f -OccupationarL^duca- 

tion woj^d do well to separate kinds of 
costs in planning for a phased implemen- 
tation of MISOE. Data collection will 
require a considerable initial investment in 
forms and training. Some of these costs 

" need to.be borne by local school districts.* 

(They will be receiving advantages by 

I securing such' data and addressing ques- 
tions to them which are relevant to local 

Ischool operation. There will be other data 
which the Division of Occupational 
Education will have to provide as well. 
Hence data collection costs will be at the 
Commonwealth as well as the local level. 

The machine reading and inputting of 
data into MISOE will be a continuing cost 
which needs to be borne by the Common- 

•wealtli. Local systems will benefit from 
their own data, but the Commonwealth's 

, benefits need to be borne both by school 
and for the Commonwealth as a whole. 

The creation of* master files of diata and 
the provision of a capacity to process the 
files when analyses are desired will be 
costs which the Commonwealth will also 
need to support. There may well be 
questions which individual users ask that 
are sufficiently esoteric to assess data 



155 



processing and analysis costs directly 
upon them. However,^ the Commonwealth 
will have to provide some general money 
in support both of data processing and oi 
empowering users to ask and get questions 
answered without having to secure special 
grants in aid every time a use is antici- 
pated- Nothing will bring about the 
demise of MISOE'-faster than a premature 
use-by-use fee which must be paid in 
order to secure use. The policy matters 
which can be addressed by MISOE are 
currently sufficiently unfamiliar to most 
educational administrators to require a 
period of general support to provide the 
education which will permit them to 
know what useful questions they can, get 
answeredr -andr ti> make - those-persoHal 
decisions which give local school fui^ds in 
support of 'worthy^uesHions they want to 
address to MISOE with some regularity. 
Finally, continual system improvement 
will have to be "provided for MISOE. A 
data file deterioriates without continual 
care and improvement, jyst like a library 
deteriorates from lack of use and atten- 
tion. The current plan is that the inter- 
active, computational-facility will expand 
as individual uses are programmed and 
serviced. This represents good financial 
planning; the system, is not over- 
programmed in the beginning and the 
programs which are developed are those 
for which use can be anticipated. How- 
ever, the problem with case-by-case con- 
struction of a system is that it quickly 
becomes a non-system. That is, if each 
case is not programmed with some larger 
system in" mind each time, the case re- 
mains an example, it does not become a 
capacity which can be used later with 
greater generality. Thought and attention 
must therefore continually be given to 
computational facihties in which ex- 
amples are to become general cases of 
computational functions rather than 



singular computations. Costs ot this atten- 
tion is what is meant by tli^ improvement 
costs which MISOE needsjto anticipate 
and secure. * ' 

Problems will also arise in the opera- 
tional management of improvement in 
MISOE, Programmers in their sdection^ 
writing itnd operation of established 
programs with new sets of data are 
ordinarily inclined to insert snvall im- 
provements gratuitously. Such improve- 
ments are fine when they operate cor- 
rectly the first time. However, difficulty 
frequently arises from small errors in 
modifying established but less efficient 
programs and production and accuracy 
tend to suffer. The result is that data files 
oper^tad ifr £<>Hjum:^ion witl^ aft- a - 
interactive computational facility can 
quickly become so confusing^to everyday 
operation that production drojus off. The 
workable answer to this condition so far 
derived has been ruthlessly "to separate 
production runs from developmental runs 
and to incorporate well proven and tested 
developmental programs into the main 
stream programs only from time to time. 
Management decisions such as this lie over 
the near horizon for MISOE, should it 
bec6me a regularly producing system. 

Administrators are likely to use 
MISOE as they might a chauffered 
automobile, namely to have someone 
drive MISOE for them. This will 
defeat the ultimate purpose of MISOE, 
which is to have all administrators 
interactively lend their minds to MISOE 
so that administrators might together 
improve education by improving the 
game of educational decision-making. 
MISOE will therefore have to antif:ipate 
that fear of the unfamiliar will cir- 
curnvent its main purpose and must do 
whatever is within its power at all times to 
disspell that fear and encourage 
familiarity. 
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,4 Model for MISOE's future Growth 

I began this coinmont by presenting a 
model of MISOE's growth. The model I 
elected to use was that of human con- 
ception and development. Within the 
model . of human growth and develop- 
ment I assessed MISOE's current state 
representing it as that of the new born 
child, a bundle of high potential* and 
great heed for a financial environment in 
which that potential can be realized. I 
then went on to challenge the local 
schools of the Commonwealth of 
Massachusetts and those who might help 
financially in further development from 
the Federal level to provide that environ- 
ment* HoweviJr, the AssociattJ Commis- 
sioner's Office of tlie Division of 
Occupational Education in the Common- 
wealtli currently faces the dilemma of 
honoring its paternity and continuing to 
nurture the bundle of potentii^l it has so 
far brought to the wonderpus state of 
visibility in the world or not. I have 
recommended that the Associate Com- 
missioner of Occupational ^Education 
elect the course of undertaking MISOE's 
implementation, but that he do so in a 
phased program, not an all out program 
starting immediately. MIS()E needs to 
start collecting data. But MISOE also 



needs 12 months of intensive testing of its . 
basic paradigms and programs, Using live 
rather than contrived data, before it 
represents itself as an operatirj^ inter- 
active, -computational-facility. 

should MISOE be given a childhood 
as I recommend, MISOE's parents can 
very well later expect some of the pains \ 
of adolescence to follow the jovs of 
MISOE's childhood. As MISOE grows it 
will demand new things of those who 
have so far served the System on terms 
they attributed to it, not terms whidh a 
young and boisterous MISOE can and 
might later demand. These will be the 
times when administrators who prefer to 
administer without developed and used 
personal skills in numerical analysis of 
education and societal data will receive 
their trial by fire, the trial of either 
changing themselves to operate with new 
ppwer because of added adjuvant, inter- 
active, computational-capability, or to 
wither without daring to change. 

MISOE holds considerable potential 
for good in our common development of 
an Educating Research Machine <Game. 
Let's help MISOE to have childhood 
and facey4:he trials and tribulations of its 
adolescence when they arrive a decade 
from now. Doing well later by doing 
good now is greatly to be desired. 
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The Massachusetts Information System 
for Occupational Educatioa (MISOE) has 
certain basic characteristics which are 
essential for decision-making in a society _ 
which is confronted with limited 
resources and virtually unhmited social 
needs.. It is the purpose pf this article 

(1) 'to describe these characteristics; 

(2) to review and discuss briefly some of 
the alleged limitations of such an ap- 
proach; (3) to indicate the potential 
value of such an information system; 

Characteristics o f MISOI: 

Rationality, The basic characteristic of 
MISOE is its rationahty. By rationality is 
meant that decisions to allocate 
resources are consistent with the objec- 
tives which the decision-maker wants to 
achieve. T4iis requires the presentation of 
alternatives to the decision-maker, each 
of which describes the resulting social 
benefits and costs. 



CompiiterizatioiU The information 
obtained by MISOE is computerized in a 
manner which allows the decision-maker, 
to interact with the computer as he 
pursues a series of questions designed to 
produce answers which will assist him in 
making a decision, in the form of alter- 
■ native lines of actioTn. . > 

Cost Effectiveness, MISOE is 
organized in such a manner as to provide 
information not only on outcomes but 
also on costs, operating on the principle 
that no outcome is **good" unless related 
to costs, and no action is **cheap" unless 
related to outcomes. 

Tradeoffs. The emphasis of MISOE is 
that there are always alternative lines of 
action and that each line of action has 
both advantages and disadvantages. 
Therefore, the decision-maker is con- 
fronted^ with the problem of "trade- 
offs", namely, wbat is he willing to give 
up in order to obtain a certain outcome. 
The system will not yield this particular 
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answer but will provide the iiitormaticMi 
to the decision-maker who can then 
TTiake the judgment/ 

PLmniuj^, MISOE provides the basic 
ing^redients tor phiining. In the past, 
plantving in education usually involved 
the nialving ot projev'tions in such areas 
as enrolmievts, teachers, building con- 
struction, etc^ Under MISOE planning 
involves more than this. It attempts to 

^predict the o^Ucomes or conseque4ices 
favorable or unfavorable ot certain 
lines of action. Such an approach in- 
volves the 'development t)t a theoretical 
model which permits such predictions. 
Such a model is required because 
decision makers usually tail to take into 

. account the hirge number ot variables or 
the coiiiplev interaction ot the variables 
on each other* 

Alleged Liniitatiofjs of the MISOl: 
Approach 

Any attempt to introduce an intorma- 
tion system that involves the application 
of rationality to decision-making tre^. 
quently results in the misinterpretHrti^J^f'^or 
, misconception of the processes involved. 
Several of these can be discussed. 

77/<' Pd^s I\nl Phobia, Any information 
sy.-^tern designed to determine outcomes 
and costs is looked up(Mi by those 
affected as ^a method by which they will 
be Md ''accountable. 'J^ctually, although 
"accountability" is "involved,. MISOE is 
primarily a system which provides a'feed- 
back mechanism by which c\)rrective 
actions can be taken in order to produce 
better the desired outcomes. Thus, it 
permits the decision-maker to make better 
decisions and by **better" one means to 
achieve better results. 

Di fficulty (\t (^itantificatiofu One of the 
most common criticisms is that certain 
"things" cannot be quantified* If this 
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criticism can be changed to certain things 
are difficult to quantify, the criticism is 
legitimate. The only response is every 
eifort must be made to quantify i:ertain 
qualitative outcomes. This can be done by 
the development of new instruments or 
obtaining ''proxies" tor certaiivoutcomes. 

lihulvquacy oj Data, In the develop- 
ment ot any management information 
system, it is uT>ually found that the data 
which heretofore has been submitted tor 
legislative and fiscal account ability are not 
satisfactory for decision-making purposes. 
Frequently, concern is expressed over tlie 
"added burdens" of submitting additional 
information. A solution to this problem 
would be (a) ^o detennine what kinds of 
data currently being submitted can be 
eliminated: apd (H) to utilize sampling 
techniques for certain types of data. 
Despite this concern, the willingness to 
submit additional data will depend c?n the 
usefulness to the recipients of the various 
reports generated by the system* 

JJi^Htial lahw ofMlSOli 

From an eccnioinist's point of view, 
given liny ted resources available, it is 
e.s.sential that a given amount of resources 
should achieve maximum outcomes or 
given outcomes should be acliy;ycd at the 
least possible costs. MISOE is designed to 
achieve this goal. As indicated previously, 
given the virtual array ot iin limited social 
needs, it is incumbent on each decision- 
maker to utili'ze this process. As social 
needs increase, each decision-maker will 
be facing inci'easing competition for 
resources. The failure to develop a man- 
agement system along the lines indicated 
by MISOE might well result in tlie 
curtailment of a particulai social program, 
if the adhiinistrator cannot account ior 
the outccmies of Iiis program. 
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